Search Results for author:
Found 184 papers, 62 papers with code
Scaling Off-Policy Reinforcement Learning with Batch and Weight Normalization
In this work, we explore CrossQ's scaling behavior with higher UTD ratios.
DIME:Diffusion-Based Maximum Entropy Reinforcement Learning
To overcome this, we propose Diffusion-Based Maximum Entropy RL (DIME).
Stable Port-Hamiltonian Neural Networks
In recent years, nonlinear dynamic system identification using artificial neural networks has garnered attention due to its manifold potential applications in virtually all branches of science and engineering.
Noise-conditioned Energy-based Annealed Rewards (NEAR): A Generative Framework for Imitation Learning from Observation
This paper introduces a new imitation learning framework based on energy-based generative models capable of learning complex, physics-dependent, robot motion policies through state-only expert motion trajectories.
Diminishing Return of Value Expansion Methods
Model-based reinforcement learning aims to increase sample efficiency, but the accuracy of dynamics models and the resulting compounding errors are often seen as key limitations.
Model-based Reinforcement Learning
reinforcement-learning
+1
Fast and Robust Visuomotor Riemannian Flow Matching Policy
Diffusion-based visuomotor policies excel at learning complex robotic tasks by effectively combining visual data with high-dimensional, multi-modal action distributions.
Grasp Diffusion Network: Learning Grasp Generators from Partial Point Clouds with Diffusion Models in SO(3)xR3
An approach to solve this problem is to leverage simulation to create large datasets of pairs of objects and grasp poses, and then learn a conditional generative model that can be prompted quickly during deployment.
Particle-based 6D Object Pose Estimation from Point Clouds using Diffusion Models
To account for this multimodality, this work proposes training a diffusion-based generative model for 6D object pose estimation.
Global Tensor Motion Planning
Batch planning is increasingly necessary to quickly produce diverse and high-quality motion plans for downstream learning applications, such as distillation and imitation learning.
A Retrospective on the Robot Air Hockey Challenge: Benchmarking Robust, Reliable, and Safe Learning Techniques for Real-world Robotics
Despite the many challenges associated with combining machine learning technology with robotics, robot learning remains one of the most promising directions for enhancing the capabilities of robots.
The Role of Domain Randomization in Training Diffusion Policies for Whole-Body Humanoid Control
Humanoids have the potential to be the ideal embodiment in environments designed for humans.
Learning Force Distribution Estimation for the GelSight Mini Optical Tactile Sensor Based on Finite Element Analysis
Contact-rich manipulation remains a major challenge in robotics.
Unsupervised Skill Discovery for Robotic Manipulation through Automatic Task Generation
Furthermore, the learned skills can be used to solve a set of unseen manipulation tasks, in simulation as well as on a real robotic platform.
Uncertainty Representations in State-Space Layers for Deep Reinforcement Learning under Partial Observability
Optimal decision-making under partial observability requires reasoning about the uncertainty of the environment's hidden state.
Handling Long-Term Safety and Uncertainty in Safe Reinforcement Learning
Safety is one of the key issues preventing the deployment of reinforcement learning techniques in real-world robots.
One Policy to Run Them All: an End-to-end Learning Approach to Multi-Embodiment Locomotion
Our experiments show that URMA can learn a locomotion policy on multiple embodiments that can be easily transferred to unseen robot platforms in simulation and the real world.
ActionFlow: Equivariant, Accurate, and Efficient Policies with Spatially Symmetric Flow Matching
Despite the impressive results of deep generative models in complex manipulation tasks, the absence of a representation that encodes intricate spatial relationships between observations and actions often limits spatial generalization, necessitating large amounts of demonstrations.
Safe and Efficient Path Planning under Uncertainty via Deep Collision Probability Fields
Estimating collision probabilities between robots and environmental obstacles or other moving agents is crucial to ensure safety during path planning.
Inverse decision-making using neural amortized Bayesian actors
They attribute behavioral variability and biases to interpretable entities such as perceptual and motor uncertainty, prior beliefs, and behavioral costs.
Bridging the gap between Learning-to-plan, Motion Primitives and Safe Reinforcement Learning
We evaluate our approach against state-of-the-art safe reinforcement learning methods, showing that our technique, particularly when exploiting task structure, outperforms baseline methods in challenging scenarios such as planning to hit in robot air hockey.
Machine Learning with Physics Knowledge for Prediction: A Survey
This survey examines the broad suite of methods and models for combining machine learning with physics knowledge for prediction and forecast, with a focus on partial differential equations.
A Comparison of Imitation Learning Algorithms for Bimanual Manipulation
Amidst the wide popularity of imitation learning algorithms in robotics, their properties regarding hyperparameter sensitivity, ease of training, data efficiency, and performance have not been well-studied in high-precision industry-inspired environments.
Deep Generative Models in Robotics: A Survey on Learning from Multimodal Demonstrations
In this survey, we aim to provide a unified and comprehensive review of the last year's progress in the use of deep generative models in robotics.
MuJoCo MPC for Humanoid Control: Evaluation on HumanoidBench
We tackle the recently introduced benchmark for whole-body humanoid control HumanoidBench using MuJoCo MPC.
PianoMime: Learning a Generalist, Dexterous Piano Player from Internet Demonstrations
In this work, we introduce PianoMime, a framework for training a piano-playing agent using internet demonstrations.
Exciting Action: Investigating Efficient Exploration for Learning Musculoskeletal Humanoid Locomotion
Learning a locomotion controller for a musculoskeletal system is challenging due to over-actuation and high-dimensional action space.
MoVEInt: Mixture of Variational Experts for Learning Human-Robot Interactions from Demonstrations
In this work, we propose a novel approach for learning a shared latent space representation for HRIs from demonstrations in a Mixture of Experts fashion for reactively generating robot actions from human observations.
Dude: Dual Distribution-Aware Context Prompt Learning For Large Vision-Language Model
Prompt learning methods are gaining increasing attention due to their ability to customize large vision-language models to new domains using pre-trained contextual knowledge and minimal training data.
ROS-LLM: A ROS framework for embodied AI with task feedback and structured reasoning
Key features of the framework include: integration of ROS with an AI agent connected to a plethora of open-source and commercial LLMs, automatic extraction of a behavior from the LLM output and execution of ROS actions/services, support for three behavior modes (sequence, behavior tree, state machine), imitation learning for adding new robot actions to the library of possible actions, and LLM reflection via human and environment feedback.
Adaptive $Q$-Network: On-the-fly Target Selection for Deep Reinforcement Learning
Deep Reinforcement Learning (RL) is well known for being highly sensitive to hyperparameters, requiring practitioners substantial efforts to optimize them for the problem at hand.
Safe Reinforcement Learning on the Constraint Manifold: Theory and Applications
Indeed, safety specifications, often represented as constraints, can be complex and non-linear, making safety challenging to guarantee in learning systems.
What Matters for Active Texture Recognition With Vision-Based Tactile Sensors
By evaluating our method on a previously published Active Clothing Perception Dataset and on a real robotic system, we establish that the choice of the active exploration strategy has only a minor influence on the recognition accuracy, whereas data augmentation and dropout rate play a significantly larger role.
Iterated $Q$-Network: Beyond One-Step Bellman Updates in Deep Reinforcement Learning
It has been observed that this scheme can be potentially generalized to carry out multiple iterations of the Bellman operator at once, benefiting the underlying learning algorithm.
Information-Theoretic Safe Bayesian Optimization
In this paper, we propose an information-theoretic safe exploration criterion that directly exploits the GP posterior to identify the most informative safe parameters to evaluate.
Kinematically Constrained Human-like Bimanual Robot-to-Human Handovers
Bimanual handovers are crucial for transferring large, deformable or delicate objects.
Structure-Aware E(3)-Invariant Molecular Conformer Aggregation Networks
Inspired by recent work on using ensembles of conformers in conjunction with 2D graph representations, we propose $\mathrm{E}$(3)-invariant molecular conformer aggregation networks.
Sharing Knowledge in Multi-Task Deep Reinforcement Learning
We study the benefit of sharing representations among tasks to enable the effective use of deep neural networks in Multi-Task Reinforcement Learning.
Parameterized Projected Bellman Operator
We formulate an optimization problem to learn PBO for generic sequential decision-making problems, and we theoretically analyze its properties in two representative classes of RL problems.
Peer Learning: Learning Complex Policies in Groups from Scratch via Action Recommendations
Eventually, we analyze the learning behavior of the peers and observe their ability to rank the agents' performance within the study group and understand which agents give reliable advice.
Model-Based Epistemic Variance of Values for Risk-Aware Policy Optimization
We propose a new UBE whose solution converges to the true posterior variance over values and leads to lower regret in tabular exploration problems.
Evetac: An Event-based Optical Tactile Sensor for Robotic Manipulation
To overcome this shortcoming, we study the idea of replacing the RGB camera with an event-based camera and introduce a new event-based optical tactile sensor called Evetac.
Learning Multimodal Latent Dynamics for Human-Robot Interaction
The generated robot motions are further adapted with Inverse Kinematics to ensure the desired physical proximity with a human, combining the ease of joint space learning and accurate task space reachability.
Multi-Task Reinforcement Learning with Mixture of Orthogonal Experts
Multi-Task Reinforcement Learning (MTRL) tackles the long-standing problem of endowing agents with skills that generalize across a variety of problems.
Towards Transferring Tactile-based Continuous Force Control Policies from Simulation to Robot
The advent of tactile sensors in robotics has sparked many ideas on how robots can leverage direct contact measurements of their environment interactions to improve manipulation tasks.
Time-Efficient Reinforcement Learning with Stochastic Stateful Policies
Stateful policies play an important role in reinforcement learning, such as handling partially observable environments, enhancing robustness, or imposing an inductive bias directly into the policy structure.
LocoMuJoCo: A Comprehensive Imitation Learning Benchmark for Locomotion
Imitation Learning (IL) holds great promise for enabling agile locomotion in embodied agents.
Robust Adversarial Reinforcement Learning via Bounded Rationality Curricula
To this end, Robust Adversarial Reinforcement Learning (RARL) trains a protagonist against destabilizing forces exercised by an adversary in a competitive zero-sum Markov game, whose optimal solution, i. e., rational strategy, corresponds to a Nash equilibrium.
Domain Randomization via Entropy Maximization
Varying dynamics parameters in simulation is a popular Domain Randomization (DR) approach for overcoming the reality gap in Reinforcement Learning (RL).
On the Benefit of Optimal Transport for Curriculum Reinforcement Learning
In this work, we focus on framing curricula as interpolations between task distributions, which has previously been shown to be a viable approach to CRL.
Tracking Control for a Spherical Pendulum via Curriculum Reinforcement Learning
Reinforcement Learning (RL) allows learning non-trivial robot control laws purely from data.
Sampling-Free Probabilistic Deep State-Space Models
Many real-world dynamical systems can be described as State-Space Models (SSMs).
Value-Distributional Model-Based Reinforcement Learning
Quantifying uncertainty about a policy's long-term performance is important to solve sequential decision-making tasks.
Motion Planning Diffusion: Learning and Planning of Robot Motions with Diffusion Models
Learning priors on trajectory distributions can help accelerate robot motion planning optimization.
Function-Space Regularization for Deep Bayesian Classification
Bayesian deep learning approaches assume model parameters to be latent random variables and infer posterior distributions to quantify uncertainty, increase safety and trust, and prevent overconfident and unpredictable behavior.
Cheap and Deterministic Inference for Deep State-Space Models of Interacting Dynamical Systems
Furthermore, we propose structured approximations to the covariance matrices of the Gaussian components in order to scale up to systems with many agents.
Model Predictive Control with Gaussian-Process-Supported Dynamical Constraints for Autonomous Vehicles
We propose a model predictive control approach for autonomous vehicles that exploits learned Gaussian processes for predicting human driving behavior.
Diminishing Return of Value Expansion Methods in Model-Based Reinforcement Learning
Therefore, we conclude that the limitation of model-based value expansion methods is not the model accuracy of the learned models.
LS-IQ: Implicit Reward Regularization for Inverse Reinforcement Learning
Recent methods for imitation learning directly learn a $Q$-function using an implicit reward formulation rather than an explicit reward function.
A Human-Centered Safe Robot Reinforcement Learning Framework with Interactive Behaviors
Deployment of Reinforcement Learning (RL) algorithms for robotics applications in the real world requires ensuring the safety of the robot and its environment.
Model-Based Uncertainty in Value Functions
We consider the problem of quantifying uncertainty over expected cumulative rewards in model-based reinforcement learning.
Fast Kinodynamic Planning on the Constraint Manifold with Deep Neural Networks
Motion planning is a mature area of research in robotics with many well-established methods based on optimization or sampling the state space, suitable for solving kinematic motion planning.
Information-Theoretic Safe Exploration with Gaussian Processes
We consider a sequential decision making task where we are not allowed to evaluate parameters that violate an a priori unknown (safety) constraint.
Hierarchical Policy Blending As Optimal Transport
We present hierarchical policy blending as optimal transport (HiPBOT).
PAC-Bayes Bounds for Bandit Problems: A Survey and Experimental Comparison
On the one hand, we found that PAC-Bayes bounds are a useful tool for designing offline bandit algorithms with performance guarantees.
How Crucial is Transformer in Decision Transformer?
On the other hand, the proposed Decision LSTM is able to achieve expert-level performance on these tasks, in addition to learning a swing-up controller on the real system.
Variational Hierarchical Mixtures for Probabilistic Learning of Inverse Dynamics
We derive two efficient variational inference techniques to learn these representations and highlight the advantages of hierarchical infinite local regression models, such as dealing with non-smooth functions, mitigating catastrophic forgetting, and enabling parameter sharing and fast predictions.
Active Exploration for Robotic Manipulation
Robotic manipulation stands as a largely unsolved problem despite significant advances in robotics and machine learning in recent years.
MILD: Multimodal Interactive Latent Dynamics for Learning Human-Robot Interaction
Modeling interaction dynamics to generate robot trajectories that enable a robot to adapt and react to a human's actions and intentions is critical for efficient and effective collaborative Human-Robot Interactions (HRI).
Hierarchical Policy Blending as Inference for Reactive Robot Control
To combine the benefits of reactive policies and planning, we propose a hierarchical motion generation method.
Inferring Smooth Control: Monte Carlo Posterior Policy Iteration with Gaussian Processes
Monte Carlo methods have become increasingly relevant for control of non-differentiable systems, approximate dynamics models and learning from data.
Safe Reinforcement Learning of Dynamic High-Dimensional Robotic Tasks: Navigation, Manipulation, Interaction
Our proposed approach achieves state-of-the-art performance in simulated high-dimensional and dynamic tasks while avoiding collisions with the environment.
Self-supervised Sequential Information Bottleneck for Robust Exploration in Deep Reinforcement Learning
Recent works based on state-visitation counts, curiosity and entropy-maximization generate intrinsic reward signals to motivate the agent to visit novel states for exploration.
Structured Q-learning For Antibody Design
Optimizing combinatorial structures is core to many real-world problems, such as those encountered in life sciences.
SE(3)-DiffusionFields: Learning smooth cost functions for joint grasp and motion optimization through diffusion
In this work, we focus on learning SE(3) diffusion models for 6DoF grasping, giving rise to a novel framework for joint grasp and motion optimization without needing to decouple grasp selection from trajectory generation.
Active Inference for Robotic Manipulation
Robotic manipulation stands as a largely unsolved problem despite significant advances in robotics and machine learning in the last decades.
Learning Implicit Priors for Motion Optimization
In this paper, we focus on the problem of integrating Energy-based Models (EBM) as guiding priors for motion optimization.
Revisiting Model-based Value Expansion
Model-based value expansion methods promise to improve the quality of value function targets and, thereby, the effectiveness of value function learning.
Accelerating Integrated Task and Motion Planning with Neural Feasibility Checking
Task and Motion Planning (TAMP) provides a hierarchical framework to handle the sequential nature of manipulation tasks by interleaving a symbolic task planner that generates a possible action sequence, with a motion planner that checks the kinematic feasibility in the geometric world, generating robot trajectories if several constraints are satisfied, e. g., a collision-free trajectory from one state to another.
Regularized Deep Signed Distance Fields for Reactive Motion Generation
Autonomous robots should operate in real-world dynamic environments and collaborate with humans in tight spaces.
Dimensionality Reduction and Prioritized Exploration for Policy Search
Black-box policy optimization is a class of reinforcement learning algorithms that explores and updates the policies at the parameter level.
An Analysis of Measure-Valued Derivatives for Policy Gradients
This estimator is unbiased, has low variance, and can be used with differentiable and non-differentiable function approximators.
Robot Learning of Mobile Manipulation with Reachability Behavior Priors
Finally, we zero-transfer our learned 6D fetching policy with BHyRL to our MM robot TIAGo++.
Graph-based Reinforcement Learning meets Mixed Integer Programs: An application to 3D robot assembly discovery
Robot assembly discovery is a challenging problem that lives at the intersection of resource allocation and motion planning.
PAC-Bayesian Lifelong Learning For Multi-Armed Bandits
We present a PAC-Bayesian analysis of lifelong learning.
An Adaptive Human Driver Model for Realistic Race Car Simulations
This work contributes to a better understanding and modeling of the human driver, aiming to expedite simulation methods in the modern vehicle development process and potentially supporting automated driving and racing technologies.
Integrating Contrastive Learning with Dynamic Models for Reinforcement Learning from Images
Recent methods for reinforcement learning from images use auxiliary tasks to learn image features that are used by the agent's policy or Q-function.
A Unified Perspective on Value Backup and Exploration in Monte-Carlo Tree Search
In this work, we propose two methods for improving the convergence rate and exploration based on a newly introduced backup operator and entropy regularization.
Distilled Domain Randomization
However, these methods are notorious for the enormous amount of required training data which is prohibitively expensive to collect on real robots.
Model-Based Reinforcement Learning via Stochastic Hybrid Models
Optimal control of general nonlinear systems is a central challenge in automation.
Robot Learning from Randomized Simulations: A Review
The rise of deep learning has caused a paradigm shift in robotics research, favoring methods that require large amounts of data.
Learning Stable Vector Fields on Lie Groups
Learning robot motions from demonstration requires models able to specify vector fields for the full robot pose when the task is defined in operational space.
Continuous-Time Fitted Value Iteration for Robust Policies
Especially for continuous control, solving this differential equation and its extension the Hamilton-Jacobi-Isaacs equation, is important as it yields the optimal policy that achieves the maximum reward on a give task.
Combining Physics and Deep Learning to learn Continuous-Time Dynamics Models
Especially for learning dynamics models, these black-box models are not desirable as the underlying principles are well understood and the standard deep networks can learn dynamics that violate these principles.
Metrics Matter: A Closer Look on Self-Paced Reinforcement Learning
Experiments demonstrate that the resulting introduction of metric structure into the curriculum allows for a well-behaving non-parametric version of SPRL that leads to stable learning performance across tasks.
Function-Space Variational Inference for Deep Bayesian Classification
Bayesian deep learning approaches assume model parameters to be latent random variables and infer posterior predictive distributions to quantify uncertainty, increase safety and trust, and prevent overconfident and unpredictable behavior.
Boosted Curriculum Reinforcement Learning
This approach, which we refer to as boosted curriculum reinforcement learning (BCRL), has the benefit of naturally increasing the representativeness of the functional space by adding a new residual each time a new task is presented.
An Empirical Analysis of Measure-Valued Derivatives for Policy Gradients
This estimator is unbiased, has low variance, and can be used with differentiable and non-differentiable function approximators.
Exploration via Empowerment Gain: Combining Novelty, Surprise and Learning Progress
We show that while such an agent is still novelty seeking, i. e. interested in exploring the whole state space, it focuses on exploration where its perceived influence is greater, avoiding areas of greater stochasticity or traps that limit its control.
High-Dimensional Bayesian Optimisation with Variational Autoencoders and Deep Metric Learning
We introduce a method combining variational autoencoders (VAEs) and deep metric learning to perform Bayesian optimisation (BO) over high-dimensional and structured input spaces.
Ranked #1 on
Molecular Graph Generation
on ZINC
Robust Value Iteration for Continuous Control Tasks
The adversarial perturbations encourage a optimal policy that is robust to changes in the dynamics.
Efficient Stochastic Optimal Control through Approximate Bayesian Input Inference
Optimal control under uncertainty is a prevailing challenge for many reasons.
Evolutionary Training and Abstraction Yields Algorithmic Generalization of Neural Computers
A key feature of intelligent behaviour is the ability to learn abstract strategies that scale and transfer to unfamiliar problems.
Composable Energy Policies for Reactive Motion Generation and Reinforcement Learning
Reactive motion generation problems are usually solved by computing actions as a sum of policies.
Value Iteration in Continuous Actions, States and Time
This algorithm enables dynamic programming for continuous states and actions with a known dynamics model.
Reinforcement Learning using Guided Observability
Due to recent breakthroughs, reinforcement learning (RL) has demonstrated impressive performance in challenging sequential decision-making problems.
Distributionally Robust Trajectory Optimization Under Uncertain Dynamics via Relative Entropy Trust-Regions
Trajectory optimization and model predictive control are essential techniques underpinning advanced robotic applications, ranging from autonomous driving to full-body humanoid control.
SKID RAW: Skill Discovery from Raw Trajectories
Integrating robots in complex everyday environments requires a multitude of problems to be solved.
Model Predictive Actor-Critic: Accelerating Robot Skill Acquisition with Deep Reinforcement Learning
Substantial advancements to model-based reinforcement learning algorithms have been impeded by the model-bias induced by the collected data, which generally hurts performance.
Deep Reinforcement Learning
Model-based Reinforcement Learning
+3
Advancing Trajectory Optimization with Approximate Inference: Exploration, Covariance Control and Adaptive Risk
Discrete-time stochastic optimal control remains a challenging problem for general, nonlinear systems under significant uncertainty, with practical solvers typically relying on the certainty equivalence assumption, replanning and/or extensive regularization.
Extended Tree Search for Robot Task and Motion Planning
Moreover, we effectively combine this skeleton space with the resultant motion variable spaces into a single extended decision space.
A Probabilistic Interpretation of Self-Paced Learning with Applications to Reinforcement Learning
Across machine learning, the use of curricula has shown strong empirical potential to improve learning from data by avoiding local optima of training objectives.
Structured Policy Representation: Imposing Stability in arbitrarily conditioned dynamic systems
We present a new family of deep neural network-based dynamic systems.
HEBO Pushing The Limits of Sample-Efficient Hyperparameter Optimisation
Our results on the Bayesmark benchmark indicate that heteroscedasticity and non-stationarity pose significant challenges for black-box optimisers.
Ranked #1 on
Hyperparameter Optimization
on Bayesmark
Perspectives on Sim2Real Transfer for Robotics: A Summary of the R:SS 2020 Workshop
This report presents the debates, posters, and discussions of the Sim2Real workshop held in conjunction with the 2020 edition of the "Robotics: Science and System" conference.
Neural Linear Models with Functional Gaussian Process Priors
Neural linear models (NLM) and Gaussian processes (GP) are both examples of Bayesian linear regression on rich feature spaces.
Convex Optimization with an Interpolation-based Projection and its Application to Deep Learning
We then propose an optimization algorithm that follows the gradient of the composition of the objective and the projection and prove its convergence for linear objectives and arbitrary convex and Lipschitz domain defining inequality constraints.
A Variational Infinite Mixture for Probabilistic Inverse Dynamics Learning
Probabilistic regression techniques in control and robotics applications have to fulfill different criteria of data-driven adaptability, computational efficiency, scalability to high dimensions, and the capacity to deal with different modalities in the data.
Differentiable Physics Models for Real-world Offline Model-based Reinforcement Learning
A limitation of model-based reinforcement learning (MBRL) is the exploitation of errors in the learned models.
Model-based Reinforcement Learning
reinforcement-learning
+2
Batch Reinforcement Learning with a Nonparametric Off-Policy Policy Gradient
Off-policy Reinforcement Learning (RL) holds the promise of better data efficiency as it allows sample reuse and potentially enables safe interaction with the environment.
High Acceleration Reinforcement Learning for Real-World Juggling with Binary Rewards
Robots that can learn in the physical world will be important to en-able robots to escape their stiff and pre-programmed movements.
Contextual Latent-Movements Off-Policy Optimization for Robotic Manipulation Skills
Parameterized movement primitives have been extensively used for imitation learning of robotic tasks.
ImitationFlow: Learning Deep Stable Stochastic Dynamic Systems by Normalizing Flows
We introduce ImitationFlow, a novel Deep generative model that allows learning complex globally stable, stochastic, nonlinear dynamics.
A Differentiable Newton Euler Algorithm for Multi-body Model Learning
In this work, we examine a spectrum of hybrid model for the domain of multi-body robot dynamics.
Differentiable Implicit Layers
In this paper, we introduce an efficient backpropagation scheme for non-constrained implicit functions.
Active Inference or Control as Inference? A Unifying View
Active inference (AI) is a persuasive theoretical framework from computational neuroscience that seeks to describe action and perception as inference-based computation.
Model-Based Quality-Diversity Search for Efficient Robot Learning
One approach that was recently used to autonomously generate a repertoire of diverse skills is a novelty based Quality-Diversity~(QD) algorithm.
Multi-Sensor Next-Best-View Planning as Matroid-Constrained Submodular Maximization
We consider the problem of creating a 3D model using depth images captured by a team of multiple robots.
Convex Regularization in Monte-Carlo Tree Search
Monte-Carlo planning and Reinforcement Learning (RL) are essential to sequential decision making.
A Deterministic Approximation to Neural SDEs
Our deterministic approximation of the transition kernel is applicable to both training and prediction.
Learning to Play Table Tennis From Scratch using Muscular Robots
This work is the first to (a) fail-safe learn of a safety-critical dynamic task using anthropomorphic robot arms, (b) learn a precision-demanding problem with a PAM-driven system despite the control challenges and (c) train robots to play table tennis without real balls.
Continuous Action Reinforcement Learning from a Mixture of Interpretable Experts
Reinforcement learning (RL) has demonstrated its ability to solve high dimensional tasks by leveraging non-linear function approximators.
Orientation Attentive Robotic Grasp Synthesis with Augmented Grasp Map Representation
Inherent morphological characteristics in objects may offer a wide range of plausible grasping orientations that obfuscates the visual learning of robotic grasping.
Hierarchical Decomposition of Nonlinear Dynamics and Control for System Identification and Policy Distillation
The control of nonlinear dynamical systems remains a major challenge for autonomous agents.
Self-Paced Deep Reinforcement Learning
Curriculum reinforcement learning (CRL) improves the learning speed and stability of an agent by exposing it to a tailored series of tasks throughout learning.
Deep Reinforcement Learning
Open-Ended Question Answering
+2
Deep Reinforcement Learning with Weighted Q-Learning
In this regard, Weighted Q-Learning (WQL) effectively reduces bias and shows remarkable results in stochastic environments.
Learning to Fly via Deep Model-Based Reinforcement Learning
Learning to control robots without requiring engineered models has been a long-term goal, promising diverse and novel applications.
Model-based Reinforcement Learning
reinforcement-learning
+2
Deep Adversarial Reinforcement Learning for Object Disentangling
The ARL framework utilizes an adversary, which is trained to steer the original agent, the protagonist, to challenging states.
Data-efficient Domain Randomization with Bayesian Optimization
Domain randomization methods tackle this problem by randomizing the physics simulator (source domain) during training according to a distribution over domain parameters in order to obtain more robust policies that are able to overcome the reality gap.
Dimensionality Reduction of Movement Primitives in Parameter Space
The empirical analysis shows that the dimensionality reduction in parameter space is more effective than in configuration space, as it enables the representation of the movements with a significant reduction of parameters.
Differential Equations as a Model Prior for Deep Learning and its Applications in Robotics
Therefore, differential equations are a promising approach to incorporate prior knowledge in machine learning models to obtain robust and interpretable models.
Metric-Based Imitation Learning Between Two Dissimilar Anthropomorphic Robotic Arms
The development of autonomous robotic systems that can learn from human demonstrations to imitate a desired behavior - rather than being manually programmed - has huge technological potential.
An Upper Bound of the Bias of Nadaraya-Watson Kernel Regression under Lipschitz Assumptions
The Nadaraya-Watson kernel estimator is among the most popular nonparameteric regression technique thanks to its simplicity.
A Probabilistic Framework for Imitating Human Race Driver Behavior
To approach this problem, we propose Probabilistic Modeling of Driver behavior (ProMoD), a modular framework which splits the task of driver behavior modeling into multiple modules.
A Nonparametric Off-Policy Policy Gradient
Reinforcement learning (RL) algorithms still suffer from high sample complexity despite outstanding recent successes.
MushroomRL: Simplifying Reinforcement Learning Research
MushroomRL is an open-source Python library developed to simplify the process of implementing and running Reinforcement Learning (RL) experiments.
Learning Human Postural Control with Hierarchical Acquisition Functions
In order to reach similar performance, we developed a hierarchical Bayesian optimization algorithm that replicates the cognitive inference and memorization process for avoiding failures in motor control tasks.
Long-Term Visitation Value for Deep Exploration in Sparse Reward Reinforcement Learning
Empirical results on classic and novel benchmarks show that the proposed approach outperforms existing methods in environments with sparse rewards, especially in the presence of rewards that create suboptimal modes of the objective function.
Generalized Mean Estimation in Monte-Carlo Tree Search
Finally, we empirically demonstrate the effectiveness of our method in well-known MDP and POMDP benchmarks, showing significant improvement in performance and convergence speed w. r. t.
Learning Algorithmic Solutions to Symbolic Planning Tasks with a Neural Computer Architecture
A key feature of intelligent behavior is the ability to learn abstract strategies that transfer to unfamiliar problems.
Receding Horizon Curiosity
Sample-efficient exploration is crucial not only for discovering rewarding experiences but also for adapting to environment changes in a task-agnostic fashion.