1 code implementation • 7 Nov 2023 • Yize Chen, Deepjyoti Deka, Yuanyuan Shi
Each generator can have distinct carbon emission rates.
no code implementations • 1 Oct 2023 • Yufan Zhang, Honglin Wen, Yuexin Bian, Yuanyuan Shi
By integrating it into the upper-level objective for minimizing expected operation cost, we convert the bilevel problem to a single-level one and derive the loss function for training the model.
no code implementations • 2 Sep 2023 • Yufan Zhang, Mengshuo Jia, Honglin Wen, Yuanyuan Shi
To this end, we formulate the forecast model parameter estimation as a bilevel program at the training phase, where the lower level solves the day-ahead and real-time energy dispatch problems, with the forecasts as parameters; the optimal solutions of the lower level are then returned to the upper level, which optimizes the model parameters given the contextual information and minimizes the expected operation cost of the two stages.
1 code implementation • 29 Jun 2023 • Christopher Yeh, Jing Yu, Yuanyuan Shi, Adam Wierman
In this work, we combine a nested convex body chasing algorithm with a robust predictive controller to achieve provably finite-time convergence to safe voltage limits in the online setting where there is uncertainty in both the network topology as well as load and generation variations.
1 code implementation • 20 Jun 2023 • Yuexin Bian, Ningkun Zheng, Yang Zheng, Bolun Xu, Yuanyuan Shi
Energy storage are strategic participants in electricity markets to arbitrage price differences.
1 code implementation • 8 Jun 2023 • Cheng Deng, Tianhang Zhang, Zhongmou He, Yi Xu, Qiyuan Chen, Yuanyuan Shi, Luoyi Fu, Weinan Zhang, Xinbing Wang, Chenghu Zhou, Zhouhan Lin, Junxian He
Large language models (LLMs) have achieved great success in general domains of natural language processing.
1 code implementation • 28 May 2023 • Wenqi Cui, Yan Jiang, Baosen Zhang, Yuanyuan Shi
We study the optimal control of multiple-input and multiple-output dynamical systems via the design of neural network-based controllers with stability and output tracking guarantees.
no code implementations • 20 May 2023 • Wenqi Cui, Guanya Shi, Yuanyuan Shi, Baosen Zhang
Ensuring the frequency stability of electric grids with increasing renewable resources is a key problem in power system operations.
no code implementations • 22 Apr 2023 • Yufan Zhang, Sujit Dey, Yuanyuan Shi
Specifically, the power network determines the charging price at various locations, while EVs on the traffic network optimize the charging power given the price, acting as price-takers.
no code implementations • 20 Mar 2023 • Jie Feng, Wenqi Cui, Jorge Cortés, Yuanyuan Shi
Deep reinforcement learning approaches are becoming appealing for the design of nonlinear controllers for voltage control problems, but the lack of stability guarantees hinders their deployment in real-world scenarios.
1 code implementation • 18 Mar 2023 • Miroslav Krstic, Luke Bhan, Yuanyuan Shi
The designs of gains for controllers and observers for PDEs, such as PDE backstepping, are mappings of system model functions into gain functions.
1 code implementation • 28 Feb 2023 • Luke Bhan, Yuanyuan Shi, Miroslav Krstic
While, in the existing PDE backstepping, finding the gain kernel requires (one offline) solution to an integral equation, the neural operator (NO) approach we propose learns the mapping from the functional coefficients of the plant PDE to the kernel function by employing a sufficiently high number of offline numerical solutions to the kernel integral equation, for a large enough number of the PDE model's different functional coefficients.
no code implementations • 28 Nov 2022 • Yuanyuan Shi, Zongyi Li, Huan Yu, Drew Steeves, Anima Anandkumar, Miroslav Krstic
State estimation is important for a variety of tasks, from forecasting to substituting for unmeasured states in feedback controllers.
1 code implementation • 27 Nov 2022 • Chi Zhang, Yuanyuan Shi, Yize Chen
Recent advancements in reinforcement learning algorithms have opened doors for researchers to operate and optimize building energy management systems autonomously.
no code implementations • 14 Nov 2022 • Ningkun Zheng, Xiaoxiang Liu, Bolun Xu, Yuanyuan Shi
This paper proposes a novel energy storage price arbitrage algorithm combining supervised learning with dynamic programming.
1 code implementation • 30 Oct 2022 • Yujia Huang, Ivan Dario Jimenez Rodriguez, huan zhang, Yuanyuan Shi, Yisong Yue
Forward invariance is a long-studied property in control theory that is used to certify that a dynamical system stays within some pre-specified set of states for all time, and also admits robustness guarantees (e. g., the certificate holds under perturbations).
1 code implementation • 26 Sep 2022 • Kai-Wen Cheng, Yuexin Bian, Yuanyuan Shi, Yize Chen
This paper examines the problem of optimizing the charging pattern of electric vehicles (EV) by taking real-time electricity grid carbon intensity into consideration.
1 code implementation • 16 Sep 2022 • Jie Feng, Yuanyuan Shi, Guannan Qu, Steven H. Low, Anima Anandkumar, Adam Wierman
In this paper, we propose a stability-constrained reinforcement learning (RL) method for real-time voltage control, that guarantees system stability both during policy learning and deployment of the learned policy.
1 code implementation • 29 Jun 2022 • Christopher Yeh, Jing Yu, Yuanyuan Shi, Adam Wierman
Voltage control generally requires accurate information about the grid's topology in order to guarantee network stability.
no code implementations • 3 Jun 2022 • Sahin Lale, Yuanyuan Shi, Guannan Qu, Kamyar Azizzadenesheli, Adam Wierman, Anima Anandkumar
However, current reinforcement learning (RL) methods lack stabilization guarantees, which limits their applicability for the control of safety-critical systems.
1 code implementation • 1 Jun 2022 • Wenqi Cui, Yan Jiang, Baosen Zhang, Yuanyuan Shi
We explicitly characterize the stability conditions and engineer neural networks that satisfy them by design.
1 code implementation • 14 Dec 2021 • Kevin Huang, Sahin Lale, Ugo Rosolia, Yuanyuan Shi, Anima Anandkumar
It then uses the top trajectories as initialization for gradient descent and applies gradient updates to each of these trajectories to find the optimal action sequence.
no code implementations • 30 Nov 2021 • Yize Chen, Yuanyuan Shi, Daniel Arnold, Sean Peisert
Fast and safe voltage regulation algorithms can serve as fundamental schemes for achieving a high level of renewable penetration in the modern distribution power grids.
no code implementations • 16 Nov 2021 • Jeffrey Ma, Alistair Letcher, Florian Schäfer, Yuanyuan Shi, Anima Anandkumar
In this work we propose polymatrix competitive gradient descent (PCGD) as a method for solving general sum competitive optimization involving arbitrary numbers of agents.
1 code implementation • NeurIPS 2021 • Yujia Huang, huan zhang, Yuanyuan Shi, J Zico Kolter, Anima Anandkumar
Certified robustness is a desirable property for deep neural networks in safety-critical applications, and popular training algorithms can certify robustness of a neural network by computing a global bound on its Lipschitz constant.
no code implementations • 18 Oct 2021 • Alexander Pan, Yongkyun Lee, huan zhang, Yize Chen, Yuanyuan Shi
Due to the proliferation of renewable energy and its intrinsic intermittency and stochasticity, current power systems face severe operational challenges.
1 code implementation • 11 Oct 2021 • Yize Chen, Daniel Arnold, Yuanyuan Shi, Sean Peisert
Case studies performed on both voltage regulation and topology control tasks demonstrated the potential vulnerabilities of the standard reinforcement learning algorithms, and possible measures of machine learning robustness and security are discussed for power systems operation tasks.
no code implementations • 30 Sep 2021 • Yuanyuan Shi, Guannan Qu, Steven Low, Anima Anandkumar, Adam Wierman
Deep reinforcement learning (RL) has been recognized as a promising tool to address the challenges in real-time control of power systems.
no code implementations • 2 Sep 2021 • Yuanyuan Shi, Bolun Xu
This paper proposes a novel end-to-end deep learning framework that simultaneously identifies demand baselines and the incentive-based agent demand response model, from the net demand measurements and incentive signals.
no code implementations • 29 Apr 2021 • Guannan Qu, Yuanyuan Shi, Sahin Lale, Anima Anandkumar, Adam Wierman
In this work, we propose an efficient online control algorithm, COvariance Constrained Online Linear Quadratic (COCO-LQ) control, that guarantees input-to-state stability for a large class of LTV systems while also minimizing the control cost.
no code implementations • 14 Sep 2020 • Yuanyuan Shi, Baosen Zhang
This is the first result (to the best of our knowledge) on the convergence property of learning algorithms with continuous action spaces that do not fall in the no-regret class.
1 code implementation • 20 Mar 2020 • Liyuan Zheng, Yuanyuan Shi, Lillian J. Ratliff, Baosen Zhang
This paper focuses on finding reinforcement learning policies for control systems with hard state and action constraints.
no code implementations • ICLR 2020 • Daniel J. Mankowitz, Nir Levine, Rae Jeong, Yuanyuan Shi, Jackie Kay, Abbas Abdolmaleki, Jost Tobias Springenberg, Timothy Mann, Todd Hester, Martin Riedmiller
We provide a framework for incorporating robustness -- to perturbations in the transition dynamics which we refer to as model misspecification -- into continuous control Reinforcement Learning (RL) algorithms.
no code implementations • COLING 2016 • Naitong Yu, Minlie Huang, Yuanyuan Shi, Xiaoyan Zhu
The main idea of our method is to leverage phrase properties to choose a subset of optimal phrases for generating the final summary.