Search Results for author: Rui Yuan

Found 11 papers, 2 papers with code

Enhancing Policy Gradient with the Polyak Step-Size Adaption

no code implementations11 Apr 2024 Yunxiang Li, Rui Yuan, Chen Fan, Mark Schmidt, Samuel Horváth, Robert M. Gower, Martin Takáč

Policy gradient is a widely utilized and foundational algorithm in the field of reinforcement learning (RL).

Reinforcement Learning (RL)

Dynamic and Memory-efficient Shape Based Methodologies for User Type Identification in Smart Grid Applications

no code implementations7 Jan 2024 Rui Yuan, S. Ali Pourmousavi, Wen L. Soong, Jon A. R. Liisberg

Detecting behind-the-meter (BTM) equipment and major appliances at the residential level and tracking their changes in real time is important for aggregators and traditional electricity utilities.

Dimensionality Reduction Edge-computing

A New Time Series Similarity Measure and Its Smart Grid Applications

no code implementations19 Oct 2023 Rui Yuan, S. Ali Pourmousavi, Wen L. Soong, Andrew J. Black, Jon A. R. Liisberg, Julian Lemos-Vinasco

As a result, there is a need for a new distance measure that can quantify both the amplitude and temporal changes of electricity time series for smart grid applications, e. g., demand response and load profiling.

Anomaly Detection Dynamic Time Warping +2

A Novel Framework for Policy Mirror Descent with General Parameterization and Linear Convergence

1 code implementation NeurIPS 2023 Carlo Alfano, Rui Yuan, Patrick Rebeschini

Modern policy optimization methods in reinforcement learning, such as TRPO and PPO, owe their success to the use of parameterized policies.

Optimal activity and battery scheduling algorithm using load and solar generation forecasts

no code implementations24 Oct 2022 Yogesh Pipada Sunil Kumar, Rui Yuan, Nam Trong Dinh, S. Ali Pourmousavi

Energy usage optimal scheduling has attracted great attention in the power system community, where various methodologies have been proposed.

Scheduling

Linear Convergence of Natural Policy Gradient Methods with Log-Linear Policies

no code implementations4 Oct 2022 Rui Yuan, Simon S. Du, Robert M. Gower, Alessandro Lazaric, Lin Xiao

We consider infinite-horizon discounted Markov decision processes and study the convergence rates of the natural policy gradient (NPG) and the Q-NPG methods with the log-linear policy class.

Policy Gradient Methods

Optimal activity and battery scheduling algorithm using load and solar generation forecast

1 code implementation6 Dec 2021 Rui Yuan, Nam Trong Dinh, Yogesh Pipada, S. Ali Pourmouasvi

In this report, we provide a technical sequence on tackling the solar PV and demand forecast as well as optimal scheduling problem proposed by the IEEE-CIS 3rd technical challenge on predict + optimize for activity and battery scheduling.

Scheduling Time Series +2

IRMAC: Interpretable Refined Motifs in Binary Classification for Smart Grid Applications

no code implementations23 Sep 2021 Rui Yuan, S. Ali Pourmousavi, Wen L. Soong, Giang Nguyen, Jon A. R. Liisberg

In this paper, we seek to identify residential consumers based on their BTM equipment, mainly rooftop photovoltaic (PV) systems and electric heating, using imported/purchased energy data from utility meters.

Binary Classification Classification +3

A general sample complexity analysis of vanilla policy gradient

no code implementations23 Jul 2021 Rui Yuan, Robert M. Gower, Alessandro Lazaric

We then instantiate our theorems in different settings, where we both recover existing results and obtain improved sample complexity, e. g., $\widetilde{\mathcal{O}}(\epsilon^{-3})$ sample complexity for the convergence to the global optimum for Fisher-non-degenerated parametrized policies.

Cannot find the paper you are looking for? You can Submit a new open access paper.