FUELVISION: A Multimodal Data Fusion and Multimodel Ensemble Algorithm for Wildfire Fuels Mapping

no code implementations • 19 Mar 2024 • Riyaaz Uddien Shaik, Mohamad Alipour, Eric Rowell, Bharathan Balaji, Adam Watts, Ertugrul Taciroglu

Accurate assessment of fuel conditions is a prerequisite for fire ignition and behavior prediction, and risk management.

OptiState: State Estimation of Legged Robots using Gated Networks with Transformer-based Vision and Kalman Filtering

1 code implementation • 30 Jan 2024 • Alexander Schperberg, Yusuke Tanaka, Saviz Mowlavi, Feng Xu, Bharathan Balaji, Dennis Hong

State estimation for legged robots is challenging due to their highly dynamic motion and limitations imposed by sensor accuracy.

Model Predictive Control

Eagle: End-to-end Deep Reinforcement Learning based Autonomous Control of PTZ Cameras

1 code implementation • 10 Apr 2023 • Sandeep Singh Sandha, Bharathan Balaji, Luis Garcia, Mani Srivastava

Existing approaches for autonomous control of pan-tilt-zoom (PTZ) cameras use multiple stages where object detection and localization are performed separately from the control of the PTZ mechanisms.

object-detection Object Detection +2

B2RL: An open-source Dataset for Building Batch Reinforcement Learning

1 code implementation • 30 Sep 2022 • Hsin-Yu Liu, Xiaohan Fu, Bharathan Balaji, Rajesh Gupta, Dezhi Hong

Batch reinforcement learning (BRL) is an emerging research area in the RL community.

Management reinforcement-learning +1

Context-Aware Streaming Perception in Dynamic Environments

1 code implementation • 16 Aug 2022 • Gur-Eyal Sela, Ionel Gog, Justin Wong, Kumar Krishna Agrawal, Xiangxi Mo, Sukrit Kalra, Peter Schafhalter, Eric Leong, Xin Wang, Bharathan Balaji, Joseph Gonzalez, Ion Stoica

These works evaluate accuracy offline, one image at a time.

Autonomous Driving

FactoredRL: Leveraging Factored Graphs for Deep Reinforcement Learning

no code implementations • 1 Jan 2021 • Bharathan Balaji, Petros Christodoulou, Xiaoyu Lu, Byungsoo Jeon, Jordan Bell-Masterson

We propose a simple class of deep reinforcement learning (RL) methods, called FactoredRL, that can leverage factored environment structures to improve the sample efficiency of existing model-based and model-free RL algorithms.

reinforcement-learning Reinforcement Learning (RL)

Quick Question: Interrupting Users for Microtasks with Reinforcement Learning

no code implementations • 18 Jul 2020 • Bo-Jhang Ho, Bharathan Balaji, Mehmet Koseoglu, Sandeep Sandha, Siyou Pei, Mani Srivastava

Human attention is a scarce resource in modern computing.

reinforcement-learning Reinforcement Learning (RL)

ORL: Reinforcement Learning Benchmarks for Online Stochastic Optimization Problems

2 code implementations • 24 Nov 2019 • Bharathan Balaji, Jordan Bell-Masterson, Enes Bilgin, Andreas Damianou, Pablo Moreno Garcia, Arpit Jain, Runfei Luo, Alvaro Maggiar, Balakrishnan Narayanaswamy, Chun Ye

Reinforcement Learning (RL) has achieved state-of-the-art results in domains such as robotics and games.

reinforcement-learning Reinforcement Learning (RL) +1

DeepRacer: Educational Autonomous Racing Platform for Experimentation with Sim2Real Reinforcement Learning

no code implementations • 5 Nov 2019 • Bharathan Balaji, Sunil Mallya, Sahika Genc, Saurabh Gupta, Leo Dirac, Vineet Khare, Gourav Roy, Tao Sun, Yunzhe Tao, Brian Townsend, Eddie Calleja, Sunil Muralidhara, Dhanasekar Karuppasamy

DeepRacer is a platform for end-to-end experimentation with RL and can be used to systematically investigate the key challenges in developing intelligent control systems.

reinforcement-learning Reinforcement Learning (RL)

ACES -- Automatic Configuration of Energy Harvesting Sensors with Reinforcement Learning

no code implementations • 4 Sep 2019 • Francesco Fraternali, Bharathan Balaji, Yuvraj Agarwal, Rajesh K. Gupta

We propose using reinforcement learning to optimize the operation of energy harvesting sensors to maximize sensing quality with available energy.

reinforcement-learning Reinforcement Learning (RL) +1

Scaling Configuration of Energy Harvesting Sensors with Reinforcement Learning

no code implementations • 27 Nov 2018 • Francesco Fraternali, Bharathan Balaji, Rajesh Gupta

We show that it is possible to reduce the number of RL policies by using a single policy for nodes that share similar lighting conditions.

reinforcement-learning Reinforcement Learning (RL)

Did you hear that? Adversarial Examples Against Automatic Speech Recognition

1 code implementation • 2 Jan 2018 • Moustafa Alzantot, Bharathan Balaji, Mani Srivastava

Speech is a common and effective way of communication between humans, and modern consumer devices such as smartphones and home hubs are equipped with deep learning based accurate automatic speech recognition to enable natural interaction between humans and machines.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +3