Search Results for author: Colin Bellinger

Found 15 papers, 7 papers with code

Learning Visual Tracking and Reaching with Deep Reinforcement Learning on a UR10e Robotic Arm

1 code implementation28 Aug 2023 Colin Bellinger, Laurence Lamarche-Cliche

The report describes the reinforcement learning environments created to facilitate policy learning with the UR10e, a robotic arm from Universal Robots, and presents our initial results in training deep Q-learning and proximal policy optimization agents on the developed reinforcement learning environments.

Q-Learning reinforcement-learning +1

Dynamic Observation Policies in Observation Cost-Sensitive Reinforcement Learning

1 code implementation5 Jul 2023 Colin Bellinger, Mark Crowley, Isaac Tamblyn

The action-perception cycle in RL, however, generally assumes that a measurement of the state of the environment is available at each time step without a cost.

OpenAI Gym reinforcement-learning +2

Reinforcement Learning-based Wavefront Sensorless Adaptive Optics Approaches for Satellite-to-Ground Laser Communication

no code implementations13 Mar 2023 Payam Parvizi, Runnan Zou, Colin Bellinger, Ross Cheriton, Davide Spinello

We propose the use of reinforcement learning (RL) to reduce the latency, size and cost of the system by up to $30-40\%$ by learning a control policy through interactions with a low-cost quadrant photodiode rather than a wavefront phase profiling camera.

Reinforcement Learning (RL)

Interpretable ML for Imbalanced Data

1 code implementation15 Dec 2022 Damien A. Dablain, Colin Bellinger, Bartosz Krawczyk, David W. Aha, Nitesh V. Chawla

We propose a set of techniques that can be used by both deep learning model users to identify, visualize and understand class prototypes, sub-concepts and outlier instances; and by imbalanced learning algorithm developers to detect features and class exemplars that are key to model performance.

Autonomous Driving Binary Classification +2

Efficient Augmentation for Imbalanced Deep Learning

1 code implementation13 Jul 2022 Damien Dablain, Colin Bellinger, Bartosz Krawczyk, Nitesh Chawla

We empirically study a convolutional neural network's internal representation of imbalanced image data and measure the generalization gap between a model's feature embeddings in the training and test sets, showing that the gap is wider for minority classes.

Data Augmentation

Automated Imbalanced Classification via Layered Learning

no code implementations5 May 2022 Vitor Cerqueira, Luis Torgo, Paula Branco, Colin Bellinger

The main contribution of our work is a new method called ICLL for tackling IBC tasks which is not based on resampling training observations.

Binary Classification Classification +2

Dynamic programming with incomplete information to overcome navigational uncertainty in a nautical environment

no code implementations29 Dec 2021 Chris Beeler, Xinkai Li, Colin Bellinger, Mark Crowley, Maia Fraser, Isaac Tamblyn

Using a novel toy nautical navigation environment, we show that dynamic programming can be used when only incomplete information about a partially observed Markov decision process (POMDP) is known.

Scientific Discovery and the Cost of Measurement -- Balancing Information and Cost in Reinforcement Learning

no code implementations14 Dec 2021 Colin Bellinger, Andriy Drozdyuk, Mark Crowley, Isaac Tamblyn

The use of reinforcement learning (RL) in scientific applications, such as materials design and automated chemistry, is increasing.

Reinforcement Learning (RL)

On the combined effect of class imbalance and concept complexity in deep learning

1 code implementation29 Jul 2021 Kushankur Ghosh, Colin Bellinger, Roberto Corizzo, Bartosz Krawczyk, Nathalie Japkowicz

Structural concept complexity, class overlap, and data scarcity are some of the most important factors influencing the performance of classifiers under class imbalance conditions.

RB-CCR: Radial-Based Combined Cleaning and Resampling algorithm for imbalanced data classification

1 code implementation9 May 2021 Michał Koziarski, Colin Bellinger, Michał Woźniak

Our $5\times2$ cross-validated results on 57 benchmark binary datasets with 9 classifiers show that RB-CCR achieves a better precision-recall trade-off than CCR and generally out-performs the state-of-the-art resampling methods in terms of AUC and G-mean.

General Classification

ReMix: Calibrated Resampling for Class Imbalance in Deep learning

no code implementations3 Dec 2020 Colin Bellinger, Roberto Corizzo, Nathalie Japkowicz

Class imbalance is a problem of significant importance in applied deep learning where trained models are exploited for decision support and automated decisions in critical areas such as health and medicine, transportation, and finance.

imbalanced classification

Active Measure Reinforcement Learning for Observation Cost Minimization

no code implementations26 May 2020 Colin Bellinger, Rory Coles, Mark Crowley, Isaac Tamblyn

Our empirical evaluation demonstrates that Amrl-Q agents are able to learn a policy and state estimator in parallel during online training.

Decision Making Q-Learning +2

Reinforcement Learning in a Physics-Inspired Semi-Markov Environment

1 code implementation15 Apr 2020 Colin Bellinger, Rory Coles, Mark Crowley, Isaac Tamblyn

Reinforcement learning (RL) has been demonstrated to have great potential in many applications of scientific discovery and design.

reinforcement-learning Reinforcement Learning (RL)

Cannot find the paper you are looking for? You can Submit a new open access paper.