Search Results for author: Xian Yeow Lee

Found 12 papers, 4 papers with code

An ensemble of convolution-based methods for fault detection using vibration signals

no code implementations5 May 2023 Xian Yeow Lee, Aman Kumar, Lasitha Vidyaratne, Aniruddha Rajendra Rao, Ahmed Farahat, Chetan Gupta

This paper focuses on solving a fault detection problem using multivariate time series of vibration signals collected from planetary gearboxes in a test rig.

Fault Detection Time Series +1

Distributed Online Non-convex Optimization with Composite Regret

no code implementations21 Sep 2022 Zhanhong Jiang, Aditya Balu, Xian Yeow Lee, Young M. Lee, Chinmay Hegde, Soumik Sarkar

To address these two issues, we propose a novel composite regret with a new network regret-based metric to evaluate distributed online optimization algorithms.

Stochastic Conservative Contextual Linear Bandits

no code implementations29 Mar 2022 Jiabin Lin, Xian Yeow Lee, Talukder Jubery, Shana Moothedath, Soumik Sarkar, Baskar Ganapathysubramanian

In this paper, we formulate a conservative stochastic contextual bandit formulation for real-time decision making when an adversary chooses a distribution on the set of possible contexts and the learner is subject to certain safety/performance constraints.

Decision Making Decision Making Under Uncertainty

MDPGT: Momentum-based Decentralized Policy Gradient Tracking

1 code implementation6 Dec 2021 Zhanhong Jiang, Xian Yeow Lee, Sin Yong Tan, Kai Liang Tan, Aditya Balu, Young M. Lee, Chinmay Hegde, Soumik Sarkar

We propose a novel policy gradient method for multi-agent reinforcement learning, which leverages two different variance-reduction techniques and does not require large batches over iterations.

Multi-agent Reinforcement Learning Policy Gradient Methods +3

A Graph Policy Network Approach for Volt-Var Control in Power Distribution Systems

no code implementations24 Sep 2021 Xian Yeow Lee, Soumik Sarkar, YuBo Wang

We conduct further analysis on the impact of both observations and actions: on the observation end, we examine the robustness of graph-based policy on two typical data acquisition errors in power systems, namely sensor communication failure and measurement misalignment.

Reinforcement Learning (RL)

PowerGym: A Reinforcement Learning Environment for Volt-Var Control in Power Distribution Systems

1 code implementation8 Sep 2021 Ting-Han Fan, Xian Yeow Lee, YuBo Wang

We introduce PowerGym, an open-source reinforcement learning environment for Volt-Var control in power distribution systems.

OpenAI Gym reinforcement-learning +1

Query-based Targeted Action-Space Adversarial Policies on Deep Reinforcement Learning Agents

1 code implementation13 Nov 2020 Xian Yeow Lee, Yasaman Esfandiari, Kai Liang Tan, Soumik Sarkar

As the complexity of CPS evolved, the focus has shifted from traditional control methods to deep reinforcement learning-based (DRL) methods for control of these systems.

reinforcement-learning Reinforcement Learning (RL) +1

Robustifying Reinforcement Learning Agents via Action Space Adversarial Training

no code implementations14 Jul 2020 Kai Liang Tan, Yasaman Esfandiari, Xian Yeow Lee, Aakanksha, Soumik Sarkar

While robust control has a long history of development, robust ML is an emerging research area that has already demonstrated its relevance and urgency.

reinforcement-learning Reinforcement Learning (RL)

Spatiotemporally Constrained Action Space Attacks on Deep Reinforcement Learning Agents

1 code implementation5 Sep 2019 Xian Yeow Lee, Sambit Ghadai, Kai Liang Tan, Chinmay Hegde, Soumik Sarkar

In this work, we first frame the problem as an optimization problem of minimizing the cumulative reward of an RL agent with decoupled constraints as the budget of attack.

reinforcement-learning Reinforcement Learning (RL)

Learning to Cope with Adversarial Attacks

no code implementations28 Jun 2019 Xian Yeow Lee, Aaron Havens, Girish Chowdhary, Soumik Sarkar

Hence, it is imperative that RL agents deployed in real-life applications have the capability to detect and mitigate adversarial attacks in an online fashion.

Decision Making Meta-Learning

Flow Shape Design for Microfluidic Devices Using Deep Reinforcement Learning

no code implementations29 Nov 2018 Xian Yeow Lee, Aditya Balu, Daniel Stoecklein, Baskar Ganapathysubramanian, Soumik Sarkar

A particularly popular form of microfluidics -- called inertial microfluidic flow sculpting -- involves placing a sequence of pillars to controllably deform an initial flow field into a desired one.

reinforcement-learning Reinforcement Learning (RL)

Cannot find the paper you are looking for? You can Submit a new open access paper.