Search Results for author: Sami Khairy

Found 9 papers, 0 papers with code

A Safe Reinforcement Learning Algorithm for Supervisory Control of Power Plants

no code implementations23 Jan 2024 Yixuan Sun, Sami Khairy, Richard B. Vilim, Rui Hu, Akshay J. Dave

In power plant control, one often needs to obtain a precise representation of the system dynamics and carefully design the control scheme accordingly.

reinforcement-learning Reinforcement Learning (RL) +1

Real-time Bandwidth Estimation from Offline Expert Demonstrations

no code implementations23 Sep 2023 Aashish Gottipati, Sami Khairy, Gabriel Mittag, Vishak Gopal, Ross Cutler

In this work, we tackle the problem of bandwidth estimation (BWE) for real-time communication systems; however, in contrast to previous works, we leverage the vast efforts of prior heuristic-based BWE methods and synergize these approaches with deep learning-based techniques.

Numerical evidence against advantage with quantum fidelity kernels on classical data

no code implementations29 Nov 2022 Lucas Slattery, Ruslan Shaydulin, Shouvanik Chakrabarti, Marco Pistoia, Sami Khairy, Stefan M. Wild

We show that the general-purpose hyperparameter tuning techniques proposed to improve the generalization of quantum kernels lead to the kernel becoming well-approximated by a classical kernel, removing the possibility of quantum advantage.

Inductive Bias Quantum Machine Learning

Multifidelity Reinforcement Learning with Control Variates

no code implementations10 Jun 2022 Sami Khairy, Prasanna Balaprakash

The proposed estimator, which is based on the method of control variates, is used to design a multifidelity Monte Carlo RL (MFMCRL) algorithm that improves the learning of the agent in the high-fidelity environment.

reinforcement-learning Reinforcement Learning (RL)

Data-Driven Random Access Optimization in Multi-Cell IoT Networks with NOMA

no code implementations2 Jan 2021 Sami Khairy, Prasanna Balaprakash, Lin X. Cai, H. Vincent Poor

To enable a capacity-optimal network, a novel formulation of random channel access management is proposed, in which the transmission probability of each IoT device is tuned to maximize the geometric mean of users' expected capacity.

Management

A Gradient-Aware Search Algorithm for Constrained Markov Decision Processes

no code implementations7 May 2020 Sami Khairy, Prasanna Balaprakash, Lin X. Cai

In this brief, we first prove that the optimization objective in the dual linear program of a finite CMDP is a piece-wise linear convex function (PWLC) with respect to the Lagrange penalty multipliers.

Management Robot Navigation

Constrained Deep Reinforcement Learning for Energy Sustainable Multi-UAV based Random Access IoT Networks with NOMA

no code implementations31 Jan 2020 Sami Khairy, Prasanna Balaprakash, Lin X. Cai, Yu Cheng

In this paper, we apply the Non-Orthogonal Multiple Access (NOMA) technique to improve the massive channel access of a wireless IoT network where solar-powered Unmanned Aerial Vehicles (UAVs) relay data from IoT devices to remote servers.

Management

Learning to Optimize Variational Quantum Circuits to Solve Combinatorial Problems

no code implementations25 Nov 2019 Sami Khairy, Ruslan Shaydulin, Lukasz Cincio, Yuri Alexeev, Prasanna Balaprakash

Proposed recently, the Quantum Approximate Optimization Algorithm (QAOA) is considered as one of the leading candidates for demonstrating quantum advantage in the near term.

Combinatorial Optimization Density Estimation +1

Reinforcement-Learning-Based Variational Quantum Circuits Optimization for Combinatorial Problems

no code implementations11 Nov 2019 Sami Khairy, Ruslan Shaydulin, Lukasz Cincio, Yuri Alexeev, Prasanna Balaprakash

The Quantum Approximate Optimization Algorithm (QAOA) is arguably one of the leading quantum algorithms that can outperform classical state-of-the-art methods in the near term.

reinforcement-learning Reinforcement Learning (RL)

Cannot find the paper you are looking for? You can Submit a new open access paper.