Search Results for author: Marco Pavone

Found 125 papers, 60 papers with code

InstantSplat: Unbounded Sparse-view Pose-free Gaussian Splatting in 40 Seconds

no code implementations29 Mar 2024 Zhiwen Fan, Wenyan Cong, Kairun Wen, Kevin Wang, Jian Zhang, Xinghao Ding, Danfei Xu, Boris Ivanovic, Marco Pavone, Georgios Pavlakos, Zhangyang Wang, Yue Wang

This pre-processing is usually conducted via a Structure-from-Motion (SfM) pipeline, a procedure that can be slow and unreliable, particularly in sparse-view scenarios with insufficient matched features for accurate reconstruction.

Novel View Synthesis SSIM

Producing and Leveraging Online Map Uncertainty in Trajectory Prediction

1 code implementation25 Mar 2024 Xunjiang Gu, Guanyu Song, Igor Gilitschenski, Marco Pavone, Boris Ivanovic

High-definition (HD) maps have played an integral role in the development of modern autonomous vehicle (AV) stacks, albeit with high associated labeling and maintenance costs.

Trajectory Forecasting

Credit vs. Discount-Based Congestion Pricing: A Comparison Study

no code implementations20 Mar 2024 Chih-Yuan Chiu, Devansh Jalota, Marco Pavone

Tolling, or congestion pricing, offers a promising traffic management policy for regulating congestion, but has also attracted criticism for placing outsized financial burdens on low-income users.

Q-SLAM: Quadric Representations for Monocular SLAM

no code implementations12 Mar 2024 Chensheng Peng, Chenfeng Xu, Yue Wang, Mingyu Ding, Heng Yang, Masayoshi Tomizuka, Kurt Keutzer, Marco Pavone, Wei Zhan

This focus results in a significant disconnect between NeRF applications, i. e., novel-view synthesis and the requirements of SLAM.

3D Reconstruction Depth Estimation +2

Mapping High-level Semantic Regions in Indoor Environments without Object Recognition

no code implementations11 Mar 2024 Roberto Bigazzi, Lorenzo Baraldi, Shreyas Kousik, Rita Cucchiara, Marco Pavone

Robots require a semantic understanding of their surroundings to operate in an efficient and explainable way in human environments.

Graph Generation Language Modelling +3

Parallelized Spatiotemporal Binding

no code implementations26 Feb 2024 Gautam Singh, Yue Wang, Jiawei Yang, Boris Ivanovic, Sungjin Ahn, Marco Pavone, Tong Che

While modern best practices advocate for scalable architectures that support long-range interactions, object-centric models are yet to fully embrace these architectures.

Object

Contingency Planning Using Bi-level Markov Decision Processes for Space Missions

1 code implementation26 Feb 2024 Somrita Banerjee, Edward Balaban, Mark Shirley, Kevin Bradner, Marco Pavone

This work focuses on autonomous contingency planning for scientific missions by enabling rapid policy computation from any off-nominal point in the state space in the event of a delay or deviation from the nominal mission plan.

Decision Making

Catch Me If You Can: Combatting Fraud in Artificial Currency Based Government Benefits Programs

no code implementations25 Feb 2024 Devansh Jalota, Matthew Tsao, Marco Pavone

To address the problem of misreporting fraud in artificial currency based benefits programs, we introduce an audit mechanism that induces a two-stage game between an administrator and users.

Driving Everywhere with Large Language Model Policy Adaptation

no code implementations8 Feb 2024 Boyi Li, Yue Wang, Jiageng Mao, Boris Ivanovic, Sushant Veer, Karen Leung, Marco Pavone

Adapting driving behavior to new environments, customs, and laws is a long-standing problem in autonomous driving, precluding the widespread deployment of autonomous vehicles (AVs).

Autonomous Driving Language Modelling +2

Learning from Teaching Regularization: Generalizable Correlations Should be Easy to Imitate

1 code implementation5 Feb 2024 Can Jin, Tong Che, Hongwu Peng, Yiyuan Li, Marco Pavone

The student learners are trained by the main model and improve the main model to capture more generalizable and teachable correlations by providing feedback.

Image Classification Language Modelling +1

RealGen: Retrieval Augmented Generation for Controllable Traffic Scenarios

no code implementations19 Dec 2023 Wenhao Ding, Yulong Cao, Ding Zhao, Chaowei Xiao, Marco Pavone

Simulation plays a crucial role in the development of autonomous vehicles (AVs) due to the potential risks associated with real-world testing.

Autonomous Vehicles In-Context Learning +1

Learning for CasADi: Data-driven Models in Numerical Optimization

1 code implementation10 Dec 2023 Tim Salzmann, Jon Arrizabalaga, Joel Andersson, Marco Pavone, Markus Ryll

While real-world problems are often challenging to analyze analytically, deep learning excels in modeling complex processes from data.

PAC-Bayes Generalization Certificates for Learned Inductive Conformal Prediction

no code implementations NeurIPS 2023 Apoorva Sharma, Sushant Veer, Asher Hancock, Heng Yang, Marco Pavone, Anirudha Majumdar

To remedy this, recent work has proposed learning model and score function parameters using data to directly optimize the efficiency of the ICP prediction sets.

Conformal Prediction Generalization Bounds

Dolphins: Multimodal Language Model for Driving

no code implementations1 Dec 2023 Yingzi Ma, Yulong Cao, Jiachen Sun, Marco Pavone, Chaowei Xiao

The quest for fully autonomous vehicles (AVs) capable of navigating complex real-world scenarios with human-like understanding and responsiveness.

Autonomous Vehicles In-Context Learning +1

Categorical Traffic Transformer: Interpretable and Diverse Behavior Prediction with Tokenized Latent

no code implementations30 Nov 2023 Yuxiao Chen, Sander Tonkens, Marco Pavone

Adept traffic models are critical to both planning and closed-loop simulation for autonomous vehicles (AV), and key design objectives include accuracy, diverse multimodal behaviors, interpretability, and downstream compatibility.

Autonomous Vehicles Common Sense Reasoning +1

A Language Agent for Autonomous Driving

1 code implementation17 Nov 2023 Jiageng Mao, Junjie Ye, Yuxi Qian, Marco Pavone, Yue Wang

Our approach, termed Agent-Driver, transforms the traditional autonomous driving pipeline by introducing a versatile tool library accessible via function calls, a cognitive memory of common sense and experiential knowledge for decision-making, and a reasoning engine capable of chain-of-thought reasoning, task planning, motion planning, and self-reflection.

Autonomous Driving Common Sense Reasoning +3

Real-time Control of Electric Autonomous Mobility-on-Demand Systems via Graph Reinforcement Learning

1 code implementation9 Nov 2023 Aaryan Singhal, Daniele Gammelli, Justin Luke, Karthik Gopalakrishnan, Dominik Helmreich, Marco Pavone

Operators of Electric Autonomous Mobility-on-Demand (E-AMoD) fleets need to make several real-time decisions such as matching available vehicles to ride requests, rebalancing idle vehicles to areas of high demand, and charging vehicles to ensure sufficient range.

Augmenting Lane Perception and Topology Understanding with Standard Definition Navigation Maps

1 code implementation7 Nov 2023 Katie Z Luo, Xinshuo Weng, Yan Wang, Shuang Wu, Jie Li, Kilian Q Weinberger, Yue Wang, Marco Pavone

We propose a novel framework to integrate SD maps into online map prediction and propose a Transformer-based encoder, SD Map Encoder Representations from transFormers, to leverage priors in SD maps for the lane-topology prediction task.

Autonomous Driving Lane Detection

Interactive Joint Planning for Autonomous Vehicles

no code implementations27 Oct 2023 Yuxiao Chen, Sushant Veer, Peter Karkus, Marco Pavone

In particular, IJP jointly optimizes over the behavior of the ego and the surrounding agents and leverages deep-learned prediction models as prediction priors that the join trajectory optimization tries to stay close to.

Autonomous Vehicles Model Predictive Control +2

Closing the Loop on Runtime Monitors with Fallback-Safe MPC

no code implementations15 Sep 2023 Rohan Sinha, Edward Schmerling, Marco Pavone

When we rely on deep-learned models for robotic perception, we must recognize that these models may behave unreliably on inputs dissimilar from the training data, compromising the closed-loop system's safety.

Conformal Prediction Model Predictive Control

Reinforcement Learning with Human Feedback for Realistic Traffic Simulation

no code implementations1 Sep 2023 Yulong Cao, Boris Ivanovic, Chaowei Xiao, Marco Pavone

This works aims to address this by developing a framework that employs reinforcement learning with human preference (RLHF) to enhance the realism of existing traffic models.

reinforcement-learning

trajdata: A Unified Interface to Multiple Human Trajectory Datasets

2 code implementations NeurIPS 2023 Boris Ivanovic, Guanyu Song, Igor Gilitschenski, Marco Pavone

The field of trajectory forecasting has grown significantly in recent years, partially owing to the release of numerous large-scale, real-world human trajectory datasets for autonomous vehicles (AVs) and pedestrian motion tracking.

Autonomous Vehicles Motion Forecasting +1

Language Conditioned Traffic Generation

1 code implementation16 Jul 2023 Shuhan Tan, Boris Ivanovic, Xinshuo Weng, Marco Pavone, Philipp Kraehenbuehl

In this work, we turn to language as a source of supervision for dynamic traffic scene generation.

Language Modelling Large Language Model +1

Multi-Predictor Fusion: Combining Learning-based and Rule-based Trajectory Predictors

no code implementations3 Jul 2023 Sushant Veer, Apoorva Sharma, Marco Pavone

Trajectory prediction modules are key enablers for safe and efficient planning of autonomous vehicles (AVs), particularly in highly interactive traffic scenarios.

Autonomous Vehicles Trajectory Prediction

Language-Guided Traffic Simulation via Scene-Level Diffusion

no code implementations10 Jun 2023 Ziyuan Zhong, Davis Rempe, Yuxiao Chen, Boris Ivanovic, Yulong Cao, Danfei Xu, Marco Pavone, Baishakhi Ray

Realistic and controllable traffic simulation is a core capability that is necessary to accelerate autonomous vehicle (AV) development.

Language Modelling Large Language Model

Bayesian Reparameterization of Reward-Conditioned Reinforcement Learning with Energy-based Models

no code implementations18 May 2023 Wenhao Ding, Tong Che, Ding Zhao, Marco Pavone

Recently, reward-conditioned reinforcement learning (RCRL) has gained popularity due to its simplicity, flexibility, and off-policy nature.

Offline RL reinforcement-learning

Graph Reinforcement Learning for Network Control via Bi-Level Optimization

1 code implementation16 May 2023 Daniele Gammelli, James Harrison, Kaidi Yang, Marco Pavone, Filipe Rodrigues, Francisco C. Pereira

Optimization problems over dynamic networks have been extensively studied and widely used in the past decades to formulate numerous real-world problems.

reinforcement-learning

Partial-View Object View Synthesis via Filtered Inversion

no code implementations3 Apr 2023 Fan-Yun Sun, Jonathan Tremblay, Valts Blukis, Kevin Lin, Danfei Xu, Boris Ivanovic, Peter Karkus, Stan Birchfield, Dieter Fox, Ruohan Zhang, Yunzhu Li, Jiajun Wu, Marco Pavone, Nick Haber

At inference, given one or more views of a novel real-world object, FINV first finds a set of latent codes for the object by inverting the generative model from multiple initial seeds.

Object

Convex Hulls of Reachable Sets

2 code implementations30 Mar 2023 Thomas Lew, Riccardo Bonalli, Marco Pavone

We study the convex hulls of reachable sets of nonlinear systems with bounded disturbances and uncertain initial conditions.

Model Predictive Control

Object Pose Estimation with Statistical Guarantees: Conformal Keypoint Detection and Geometric Uncertainty Propagation

1 code implementation CVPR 2023 Heng Yang, Marco Pavone

Geometric uncertainty propagation, on the other, propagates the geometric constraints on the keypoints to the 6D object pose, leading to a Pose UnceRtainty SEt (PURSE) that guarantees coverage of the groundtruth pose with the same probability.

Conformal Prediction Keypoint Detection +1

FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularization

2 code implementations CVPR 2023 Jiawei Yang, Marco Pavone, Yue Wang

One is to regularize the frequency range of NeRF's inputs, while the other is to penalize the near-camera density fields.

Neural Rendering Novel View Synthesis

Dynamic locational marginal emissions via implicit differentiation

no code implementations28 Feb 2023 Lucas Fuentes Valenzuela, Anthony Degleris, Abbas El Gamal, Marco Pavone, Ram Rajagopal

The method is model agnostic; it can compute LMEs for any convex optimization-based dispatch model, including some of the complex dispatch models employed by system operators in real electricity systems.

Learning Control-Oriented Dynamical Structure from Data

1 code implementation6 Feb 2023 Spencer M. Richards, Jean-Jacques Slotine, Navid Azizan, Marco Pavone

Even for known nonlinear dynamical systems, feedback controller synthesis is a difficult problem that often requires leveraging the particular structure of the dynamics to induce a stable closed-loop system.

A System-Level View on Out-of-Distribution Data in Robotics

no code implementations28 Dec 2022 Rohan Sinha, Apoorva Sharma, Somrita Banerjee, Thomas Lew, Rachel Luo, Spencer M. Richards, Yixiao Sun, Edward Schmerling, Marco Pavone

When testing conditions differ from those represented in training data, so-called out-of-distribution (OOD) inputs can mar the reliability of learned components in the modern robot autonomy stack.

Hybrid Multi-agent Deep Reinforcement Learning for Autonomous Mobility on Demand Systems

1 code implementation14 Dec 2022 Tobias Enders, James Harrison, Marco Pavone, Maximilian Schiffer

We consider the sequential decision-making problem of making proactive request assignment and rejection decisions for a profit-maximizing operator of an autonomous mobility on demand system.

Decision Making reinforcement-learning +1

DiffStack: A Differentiable and Modular Control Stack for Autonomous Vehicles

no code implementations13 Dec 2022 Peter Karkus, Boris Ivanovic, Shie Mannor, Marco Pavone

To enable the joint optimization of AV stacks while retaining modularity, we present DiffStack, a differentiable and modular stack for prediction, planning, and control.

Autonomous Vehicles

Adaptive Robust Model Predictive Control via Uncertainty Cancellation

no code implementations2 Dec 2022 Rohan Sinha, James Harrison, Spencer M. Richards, Marco Pavone

We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component.

Meta-Learning Model Predictive Control

Online Distribution Shift Detection via Recency Prediction

no code implementations17 Nov 2022 Rachel Luo, Rohan Sinha, Yixiao Sun, Ali Hindy, Shengjia Zhao, Silvio Savarese, Edward Schmerling, Marco Pavone

When deploying modern machine learning-enabled robotic systems in high-stakes applications, detecting distribution shift is critical.

Expanding the Deployment Envelope of Behavior Prediction via Adaptive Meta-Learning

2 code implementations23 Sep 2022 Boris Ivanovic, James Harrison, Marco Pavone

Learning-based behavior prediction methods are increasingly being deployed in real-world autonomous systems, e. g., in fleets of self-driving vehicles, which are beginning to commercially operate in major cities across the world.

Meta-Learning regression

Data Lifecycle Management in Evolving Input Distributions for Learning-based Aerospace Applications

1 code implementation14 Sep 2022 Somrita Banerjee, Apoorva Sharma, Edward Schmerling, Max Spolaor, Michael Nemerouf, Marco Pavone

Algorithms within this framework are evaluated based on (1) model performance throughout mission lifetime and (2) cumulative costs associated with labeling and model retraining.

Active Learning Management +2

BITS: Bi-level Imitation for Traffic Simulation

1 code implementation26 Aug 2022 Danfei Xu, Yuxiao Chen, Boris Ivanovic, Marco Pavone

We empirically validate our method, named Bi-level Imitation for Traffic Simulation (BITS), with scenarios from two large-scale driving datasets and show that BITS achieves balanced traffic simulation performance in realism, diversity, and long-horizon stability.

Autonomous Vehicles

Robust Trajectory Prediction against Adversarial Attacks

no code implementations29 Jul 2022 Yulong Cao, Danfei Xu, Xinshuo Weng, Zhuoqing Mao, Anima Anandkumar, Chaowei Xiao, Marco Pavone

We demonstrate that our method is able to improve the performance by 46% on adversarial data and at the cost of only 3% performance degradation on clean data, compared to the model trained with clean data.

Autonomous Driving Data Augmentation +1

ScePT: Scene-consistent, Policy-based Trajectory Predictions for Planning

1 code implementation CVPR 2022 Yuxiao Chen, Boris Ivanovic, Marco Pavone

In this work, we present ScePT, a policy planning-based trajectory prediction model that generates accurate, scene-consistent trajectory predictions suitable for autonomous system motion planning.

Motion Planning Trajectory Prediction

Second-Order Sensitivity Analysis for Bilevel Optimization

3 code implementations4 May 2022 Robert Dyro, Edward Schmerling, Nikos Arechiga, Marco Pavone

Many existing approaches to bilevel optimization employ first-order sensitivity analysis, based on the implicit function theorem (IFT), for the lower problem to derive a gradient of the lower problem solution with respect to its parameters; this IFT gradient is then used in a first-order optimization method for the upper problem.

Bilevel Optimization

Safe Reinforcement Learning Using Black-Box Reachability Analysis

1 code implementation15 Apr 2022 Mahmoud Selim, Amr Alanwar, Shreyas Kousik, Grace Gao, Marco Pavone, Karl H. Johansson

Reinforcement learning (RL) is capable of sophisticated motion planning and control for robots in uncertain environments.

Motion Planning reinforcement-learning +2

Control-oriented meta-learning

1 code implementation14 Apr 2022 Spencer M. Richards, Navid Azizan, Jean-Jacques Slotine, Marco Pavone

Real-time adaptation is imperative to the control of robots operating in complex, dynamic environments.

Meta-Learning regression

Online Learning for Traffic Routing under Unknown Preferences

1 code implementation31 Mar 2022 Devansh Jalota, Karthik Gopalakrishnan, Navid Azizan, Ramesh Johari, Marco Pavone

at each period, we show that our approach obtains an expected regret and road capacity violation of $O(\sqrt{T})$, where $T$ is the number of periods over which tolls are updated.

Real-time Neural-MPC: Deep Learning Model Predictive Control for Quadrotors and Agile Robotic Platforms

2 code implementations15 Mar 2022 Tim Salzmann, Elia Kaufmann, Jon Arrizabalaga, Marco Pavone, Davide Scaramuzza, Markus Ryll

Our experiments, performed in simulation and the real world onboard a highly agile quadrotor platform, demonstrate the capabilities of the described system to run learned models with, previously infeasible, large modeling capacity using gradient-based online optimization MPC.

Model Predictive Control

Motron: Multimodal Probabilistic Human Motion Forecasting

1 code implementation CVPR 2022 Tim Salzmann, Marco Pavone, Markus Ryll

We present Motron, a multimodal, probabilistic, graph-structured model, that captures human's multimodality using probabilistic methods while being able to output deterministic maximum-likelihood motions and corresponding confidence values for each mode.

Motion Forecasting

A Unified View of SDP-based Neural Network Verification through Completely Positive Programming

no code implementations6 Mar 2022 Robin Brown, Edward Schmerling, Navid Azizan, Marco Pavone

Verifying that input-output relationships of a neural network conform to prescribed operational specifications is a key enabler towards deploying these networks in safety-critical applications.

Graph Meta-Reinforcement Learning for Transferable Autonomous Mobility-on-Demand

1 code implementation15 Feb 2022 Daniele Gammelli, Kaidi Yang, James Harrison, Filipe Rodrigues, Francisco C. Pereira, Marco Pavone

Autonomous Mobility-on-Demand (AMoD) systems represent an attractive alternative to existing transportation paradigms, currently challenged by urbanization and increasing travel needs.

Meta Reinforcement Learning reinforcement-learning +1

Matching with Transfers under Distributional Constraints

no code implementations10 Feb 2022 Devansh Jalota, Michael Ostrovsky, Marco Pavone

To this end, we first consider the setting when the number of institutions (e. g., firms in a labor market) is one and show that equilibrium arrangements exist irrespective of the nature of the constraint structure or the agents' preferences.

Data-Driven Chance Constrained Control using Kernel Distribution Embeddings

no code implementations8 Feb 2022 Adam J. Thorpe, Thomas Lew, Meeko M. K. Oishi, Marco Pavone

We present a data-driven algorithm for efficiently computing stochastic control policies for general joint chance constrained optimal control problems.

A Simple and Efficient Sampling-based Algorithm for General Reachability Analysis

2 code implementations10 Dec 2021 Thomas Lew, Lucas Janson, Riccardo Bonalli, Marco Pavone

In this work, we analyze an efficient sampling-based algorithm for general-purpose reachability analysis, which remains a notoriously challenging problem with applications ranging from neural network verification to safety analysis of dynamical systems.

On the Problem of Reformulating Systems with Uncertain Dynamics as a Stochastic Differential Equation

no code implementations11 Nov 2021 Thomas Lew, Apoorva Sharma, James Harrison, Edward Schmerling, Marco Pavone

We identify an issue in recent approaches to learning-based control that reformulate systems with uncertain dynamics using a stochastic differential equation.

MTP: Multi-Hypothesis Tracking and Prediction for Reduced Error Propagation

1 code implementation18 Oct 2021 Xinshuo Weng, Boris Ivanovic, Marco Pavone

Recently, there has been tremendous progress in developing each individual module of the standard perception-planning robot autonomy pipeline, including detection, tracking, prediction of other agents' trajectories, and ego-agent trajectory planning.

Trajectory Planning

Coordinated Multi-Agent Pathfinding for Drones and Trucks over Road Networks

1 code implementation17 Oct 2021 Shushman Choudhury, Kiril Solovey, Mykel Kochenderfer, Marco Pavone

The second stage solves only for drones, by routing them over a composite of the road network and the transit network defined by truck paths from the first stage.

Multi-Agent Path Finding

Propagating State Uncertainty Through Trajectory Forecasting

1 code implementation7 Oct 2021 Boris Ivanovic, Yifeng Lin, Shubham Shrivastava, Punarjay Chakravarty, Marco Pavone

As a result, perceptual uncertainties are not propagated through forecasting and predictions are frequently overconfident.

Trajectory Forecasting

Injecting Planning-Awareness into Prediction and Detection Evaluation

1 code implementation7 Oct 2021 Boris Ivanovic, Marco Pavone

Detecting other agents and forecasting their behavior is an integral part of the modern robotic autonomy stack, especially in safety-critical scenarios entailing human-robot interaction such as autonomous driving.

Autonomous Driving Decision Making +1

Data Sharing and Compression for Cooperative Networked Control

1 code implementation NeurIPS 2021 Jiangnan Cheng, Marco Pavone, Sachin Katti, Sandeep Chinchali, Ao Tang

Sharing forecasts of network timeseries data, such as cellular or electricity load patterns, can improve independent control applications ranging from traffic scheduling to power generation.

Scheduling

Sample-Efficient Safety Assurances using Conformal Prediction

no code implementations28 Sep 2021 Rachel Luo, Shengjia Zhao, Jonathan Kuck, Boris Ivanovic, Silvio Savarese, Edward Schmerling, Marco Pavone

When deploying machine learning models in high-stakes robotics applications, the ability to detect unsafe situations is crucial.

Conformal Prediction Robotic Grasping

Tube-Certified Trajectory Tracking for Nonlinear Systems With Robust Control Contraction Metrics

1 code implementation9 Sep 2021 Pan Zhao, Arun Lakshmanan, Kasey Ackerman, Aditya Gahlawat, Marco Pavone, Naira Hovakimyan

This paper presents an approach towards guaranteed trajectory tracking for nonlinear control-affine systems subject to external disturbances based on robust control contraction metrics (CCM) that aims to minimize the $\mathcal L_\infty$ gain from the disturbances to nominal-actual trajectory deviations.

Motion Planning valid

Towards Data-Driven Synthesis of Autonomous Vehicle Safety Concepts

no code implementations30 Jul 2021 Karen Leung, Andrea Bajcsy, Edward Schmerling, Marco Pavone

As safety-critical autonomous vehicles (AVs) will soon become pervasive in our society, a number of safety concepts for trusted AV deployment have recently been proposed throughout industry and academia.

Autonomous Vehicles Inductive Bias

Bayesian Embeddings for Few-Shot Open World Recognition

no code implementations29 Jul 2021 John Willes, James Harrison, Ali Harakeh, Chelsea Finn, Marco Pavone, Steven Waslander

As autonomous decision-making agents move from narrow operating environments to unstructured worlds, learning systems must move from a closed-world formulation to an open-world and few-shot setting in which agents continuously learn new classes from small amounts of information.

Decision Making Few-Shot Learning

Rethinking Trajectory Forecasting Evaluation

no code implementations21 Jul 2021 Boris Ivanovic, Marco Pavone

Forecasting the behavior of other agents is an integral part of the modern robotic autonomy stack, especially in safety-critical scenarios with human-robot interaction, such as autonomous driving.

Autonomous Driving Decision Making +1

Joint Optimization of Autonomous Electric Vehicle Fleet Operations and Charging Station Siting

no code implementations1 Jul 2021 Justin Luke, Mauro Salazar, Ram Rajagopal, Marco Pavone

Charging infrastructure is the coupling link between power and transportation networks, thus determining charging station siting is necessary for planning of power and transportation systems.

Analysis and Control of Autonomous Mobility-on-Demand Systems

no code implementations28 Jun 2021 Gioele Zardini, Nicolas Lanzetti, Marco Pavone, Emilio Frazzoli

We provide a comprehensive review of methods and tools to model and solve problems related to autonomous mobility-on-demand systems.

Autonomous Vehicles

Graph Neural Network Reinforcement Learning for Autonomous Mobility-on-Demand Systems

1 code implementation23 Apr 2021 Daniele Gammelli, Kaidi Yang, James Harrison, Filipe Rodrigues, Francisco C. Pereira, Marco Pavone

Autonomous mobility-on-demand (AMoD) systems represent a rapidly developing mode of transportation wherein travel requests are dynamically handled by a coordinated fleet of robotic, self-driving vehicles.

Decision Making reinforcement-learning +1

Adaptive Robust Model Predictive Control with Matched and Unmatched Uncertainty

no code implementations16 Apr 2021 Rohan Sinha, James Harrison, Spencer M. Richards, Marco Pavone

We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component.

Model Predictive Control

Particle MPC for Uncertain and Learning-Based Control

no code implementations6 Apr 2021 Robert Dyro, James Harrison, Apoorva Sharma, Marco Pavone

As robotic systems move from highly structured environments to open worlds, incorporating uncertainty from dynamics learning or state estimation into the control pipeline is essential for robust performance.

Model-based Reinforcement Learning Model Predictive Control

Balancing Fairness and Efficiency in Traffic Routing via Interpolated Traffic Assignment

2 code implementations31 Mar 2021 Devansh Jalota, Kiril Solovey, Matthew Tsao, Stephen Zoepf, Marco Pavone

To address the inherent unfairness of SO routing, we study the ${\beta}$-fair SO problem whose goal is to minimize the total travel time while guaranteeing a ${\beta\geq 1}$ level of unfairness, which specifies the maximum possible ratio between the travel times of different users with shared origins and destinations.

Fairness

Adaptive-Control-Oriented Meta-Learning for Nonlinear Systems

1 code implementation7 Mar 2021 Spencer M. Richards, Navid Azizan, Jean-Jacques Slotine, Marco Pavone

Real-time adaptation is imperative to the control of robots operating in complex, dynamic environments.

Meta-Learning regression

Sketching Curvature for Efficient Out-of-Distribution Detection for Deep Neural Networks

1 code implementation24 Feb 2021 Apoorva Sharma, Navid Azizan, Marco Pavone

In order to safely deploy Deep Neural Networks (DNNs) within the perception pipelines of real-time decision making systems, there is a need for safeguards that can detect out-of-training-distribution (OoD) inputs both efficiently and accurately.

Decision Making Out-of-Distribution Detection +1

Local Calibration: Metrics and Recalibration

no code implementations22 Feb 2021 Rachel Luo, Aadyot Bhatnagar, Yu Bai, Shengjia Zhao, Huan Wang, Caiming Xiong, Silvio Savarese, Stefano Ermon, Edward Schmerling, Marco Pavone

In this work, we propose the local calibration error (LCE) to span the gap between average and individual reliability.

Decision Making Fairness

Risk-sensitive safety analysis using Conditional Value-at-Risk

1 code implementation28 Jan 2021 Margaret P. Chapman, Riccardo Bonalli, Kevin M. Smith, Insoon Yang, Marco Pavone, Claire J. Tomlin

In addition, we propose a second definition for risk-sensitive safe sets and provide a tractable method for their estimation without using a parameter-dependent upper bound.

Sampling Training Data for Continual Learning Between Robots and the Cloud

no code implementations12 Dec 2020 Sandeep Chinchali, Evgenya Pergament, Manabu Nakanoya, Eyal Cidon, Edward Zhang, Dinesh Bharadia, Marco Pavone, Sachin Katti

Today's robotic fleets are increasingly measuring high-volume video and LIDAR sensory streams, which can be mined for valuable training data, such as rare scenes of road construction sites, to steadily improve robotic perception models.

Cloud Computing Continual Learning +2

Leveraging Neural Network Gradients within Trajectory Optimization for Proactive Human-Robot Interactions

1 code implementation2 Dec 2020 Simon Schaefer, Karen Leung, Boris Ivanovic, Marco Pavone

To achieve seamless human-robot interactions, robots need to intimately reason about complex interaction dynamics and future human behaviors within their motion planning process.

Motion Planning Navigate +1

Task-relevant Representation Learning for Networked Robotic Perception

no code implementations6 Nov 2020 Manabu Nakanoya, Sandeep Chinchali, Alexandros Anemogiannis, Akul Datta, Sachin Katti, Marco Pavone

However, today's representations for sensory data are mostly designed for human, not robotic, perception and thus often waste precious compute or wireless network resources to transmit unimportant parts of a scene that are unnecessary for a high-level robotic task.

Motion Planning Representation Learning

Evidential Sparsification of Multimodal Latent Spaces in Conditional Variational Autoencoders

1 code implementation NeurIPS 2020 Masha Itkina, Boris Ivanovic, Ransalu Senanayake, Mykel J. Kochenderfer, Marco Pavone

Discrete latent spaces in variational autoencoders have been shown to effectively capture the data distribution for many real-world problems such as natural language understanding, human intent prediction, and visual scene representation.

Image Generation Motion Planning +1

CoCo: Learning Strategies for Online Mixed-Integer Control

no code implementations NeurIPS Workshop LMCA 2020 Abhishek Cauligi, Preston Culbertson, Mac Schwager, Bartolomeo Stellato, Marco Pavone

Mixed-integer convex programming (MICP) is a popular modeling framework for solving discrete and combinatorial optimization problems arising in various settings.

Combinatorial Optimization

Risk-Sensitive Sequential Action Control with Multi-Modal Human Trajectory Forecasting for Safe Crowd-Robot Interaction

no code implementations12 Sep 2020 Haruki Nishimura, Boris Ivanovic, Adrien Gaidon, Marco Pavone, Mac Schwager

This paper presents a novel online framework for safe crowd-robot interaction based on risk-sensitive stochastic optimal control, wherein the risk is modeled by the entropic risk measure.

Model Predictive Control Trajectory Forecasting

Safe Active Dynamics Learning and Control: A Sequential Exploration-Exploitation Framework

no code implementations26 Aug 2020 Thomas Lew, Apoorva Sharma, James Harrison, Andrew Bylard, Marco Pavone

In this work, we propose a practical and theoretically-justified approach to maintaining safety in the presence of dynamics uncertainty.

Meta-Learning Meta Reinforcement Learning

Multimodal Deep Generative Models for Trajectory Prediction: A Conditional Variational Autoencoder Approach

no code implementations10 Aug 2020 Boris Ivanovic, Karen Leung, Edward Schmerling, Marco Pavone

Human behavior prediction models enable robots to anticipate how humans may react to their actions, and hence are instrumental to devising safe and proactive robot planning algorithms.

Trajectory Prediction

Backpropagation through Signal Temporal Logic Specifications: Infusing Logical Structure into Gradient-Based Methods

1 code implementation31 Jul 2020 Karen Leung, Nikos Aréchiga, Marco Pavone

This paper presents a technique, named STLCG, to compute the quantitative semantics of Signal Temporal Logic (STL) formulas using computation graphs.

Continuous Meta-Learning without Tasks

2 code implementations NeurIPS 2020 James Harrison, Apoorva Sharma, Chelsea Finn, Marco Pavone

In this work, we enable the application of generic meta-learning algorithms to settings where this task segmentation is unavailable, such as continual online learning with a time-varying task.

Image Classification Meta-Learning +2

Efficient Large-Scale Multi-Drone Delivery Using Transit Networks

2 code implementations26 Sep 2019 Shushman Choudhury, Kiril Solovey, Mykel J. Kochenderfer, Marco Pavone

Our results show that the framework computes solutions typically within a few seconds on commodity hardware, and that drones travel up to $360 \%$ of their flight range with public transit.

Learning Stabilizable Nonlinear Dynamics with Contraction-Based Regularization

1 code implementation29 Jul 2019 Sumeet Singh, Spencer M. Richards, Vikas Sindhwani, Jean-Jacques E. Slotine, Marco Pavone

We propose a novel framework for learning stabilizable nonlinear dynamical systems for continuous control tasks in robotics.

Continuous Control

High-Dimensional Optimization in Adaptive Random Subspaces

no code implementations NeurIPS 2019 Jonathan Lacotte, Mert Pilanci, Marco Pavone

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces.

Vocal Bursts Intensity Prediction

On the Interaction between Autonomous Mobility on Demand Systems and Power Distribution Networks -- An Optimal Power Flow Approach

1 code implementation1 May 2019 Alvaro Estandia, Maximilian Schiffer, Federico Rossi, Justin Luke, Emre Can Kara, Ram Rajagopal, Marco Pavone

Specifically, we extend previous results on an optimization-based modeling approach for electric AMoD systems to jointly control an electric AMoD fleet and a series of PDNs, and analyze the benefit of coordination under load balancing constraints.

Self-Driving Cars

Network Offloading Policies for Cloud Robotics: a Learning-based Approach

no code implementations15 Feb 2019 Sandeep Chinchali, Apoorva Sharma, James Harrison, Amine Elhafsi, Daniel Kang, Evgenya Pergament, Eyal Cidon, Sachin Katti, Marco Pavone

In this paper, we formulate a novel Robot Offloading Problem --- how and when should robots offload sensing tasks, especially if they are uncertain, to improve accuracy while minimizing the cost of cloud communication?

Decision Making object-detection +1

Robust and Adaptive Planning under Model Uncertainty

no code implementations9 Jan 2019 Apoorva Sharma, James Harrison, Matthew Tsao, Marco Pavone

The first, RAMCP-F, converges to an optimal risk-sensitive policy without having to rebuild the search tree as the underlying belief over models is perturbed.

Computational Efficiency Decision Making

The Trajectron: Probabilistic Multi-Agent Trajectory Modeling With Dynamic Spatiotemporal Graphs

1 code implementation ICCV 2019 Boris Ivanovic, Marco Pavone

Developing safe human-robot interaction systems is a necessary step towards the widespread integration of autonomous agents in society.

Decision Making Motion Forecasting +2

Risk-Sensitive Generative Adversarial Imitation Learning

no code implementations13 Aug 2018 Jonathan Lacotte, Mohammad Ghavamzadeh, Yin-Lam Chow, Marco Pavone

We then derive two different versions of our RS-GAIL optimization problem that aim at matching the risk profiles of the agent and the expert w. r. t.

Imitation Learning

Meta-Learning Priors for Efficient Online Bayesian Regression

3 code implementations24 Jul 2018 James Harrison, Apoorva Sharma, Marco Pavone

However, this approach suffers from two main drawbacks: (1) it is computationally inefficient, as computation scales poorly with the number of samples; and (2) it can be data inefficient, as encoding prior knowledge that can aid the model through the choice of kernel and associated hyperparameters is often challenging and unintuitive.

Meta-Learning regression

BaRC: Backward Reachability Curriculum for Robotic Reinforcement Learning

1 code implementation16 Jun 2018 Boris Ivanovic, James Harrison, Apoorva Sharma, Mo Chen, Marco Pavone

Our Backward Reachability Curriculum (BaRC) begins policy training from states that require a small number of actions to accomplish the task, and expands the initial state distribution backwards in a dynamically-consistent manner once the policy optimization algorithm demonstrates sufficient performance.

Continuous Control reinforcement-learning +1

Safe Motion Planning in Unknown Environments: Optimality Benchmarks and Tractable Policies

no code implementations16 Apr 2018 Lucas Janson, Tommy Hu, Marco Pavone

This paper addresses the problem of planning a safe (i. e., collision-free) trajectory from an initial state to a goal region when the obstacle space is a-priori unknown and is incrementally revealed online, e. g., through line-of-sight perception.

Motion Planning

Generative Modeling of Multimodal Multi-Human Behavior

1 code implementation6 Mar 2018 Boris Ivanovic, Edward Schmerling, Karen Leung, Marco Pavone

This work presents a methodology for modeling and predicting human behavior in settings with N humans interacting in highly multimodal scenarios (i. e. where there are many possible highly-distinct futures).

Robotics Human-Computer Interaction

Risk-sensitive Inverse Reinforcement Learning via Semi- and Non-Parametric Methods

1 code implementation28 Nov 2017 Sumeet Singh, Jonathan Lacotte, Anirudha Majumdar, Marco Pavone

The literature on Inverse Reinforcement Learning (IRL) typically assumes that humans take actions in order to minimize the expected value of a cost function, i. e., that humans are risk neutral.

Decision Making reinforcement-learning +1

How Should a Robot Assess Risk? Towards an Axiomatic Theory of Risk in Robotics

no code implementations30 Oct 2017 Anirudha Majumdar, Marco Pavone

We discuss general representation theorems that precisely characterize the class of metrics that satisfy these axioms (referred to as distortion risk metrics), and provide instantiations that can be used in applications.

Decision Making

Multimodal Probabilistic Model-Based Planning for Human-Robot Interaction

1 code implementation25 Oct 2017 Edward Schmerling, Karen Leung, Wolf Vollprecht, Marco Pavone

This paper presents a method for constructing human-robot interaction policies in settings where multimodality, i. e., the possibility of multiple highly distinct futures, plays a critical role in decision making.

Decision Making

Data-Driven Model Predictive Control of Autonomous Mobility-on-Demand Systems

no code implementations20 Sep 2017 Ramon Iglesias, Federico Rossi, Kevin Wang, David Hallac, Jure Leskovec, Marco Pavone

The goal of this paper is to present an end-to-end, data-driven framework to control Autonomous Mobility-on-Demand systems (AMoD, i. e. fleets of self-driving vehicles).

Robotics Multiagent Systems Systems and Control Applications

Learning Sampling Distributions for Robot Motion Planning

2 code implementations16 Sep 2017 Brian Ichter, James Harrison, Marco Pavone

This paper proposes a methodology for non-uniform sampling, whereby a sampling distribution is learned from demonstrations, and then used to bias sampling.

Collision Avoidance Motion Planning

On the interaction between Autonomous Mobility-on-Demand systems and the power network: models and coordination algorithms

1 code implementation14 Sep 2017 Federico Rossi, Ramon Iglesias, Mahnoosh Alizadeh, Marco Pavone

We assess the performance of the mode by studying a hypothetical AMoD system in Dallas-Fort Worth and its impact on the Texas power network.

Systems and Control Multiagent Systems Robotics

Mixed Strategy for Constrained Stochastic Optimal Control

no code implementations6 Jul 2016 Masahiro Ono, Mahmoud El Chamie, Marco Pavone, Behcet Acikmese

We found that the same result holds for stochastic optimal control problems with continuous state and action spaces. Furthermore, we show the randomization of control input can result in reduced cost when the optimization problem is nonconvex, and the cost reduction is equal to the duality gap.

Model Predictive Control

Risk-Constrained Reinforcement Learning with Percentile Risk Criteria

no code implementations5 Dec 2015 Yin-Lam Chow, Mohammad Ghavamzadeh, Lucas Janson, Marco Pavone

In many sequential decision-making problems one is interested in minimizing an expected cumulative cost while taking into account \emph{risk}, i. e., increased awareness of events of small probability and high consequences.

Decision Making Marketing +2

Two Phase $Q-$learning for Bidding-based Vehicle Sharing

no code implementations29 Sep 2015 Yin-Lam Chow, Jia Yuan Yu, Marco Pavone

We consider one-way vehicle sharing systems where customers can rent a car at one station and drop it off at another.

Decision Making Q-Learning +1

Risk-Sensitive and Robust Decision-Making: a CVaR Optimization Approach

no code implementations NeurIPS 2015 Yin-Lam Chow, Aviv Tamar, Shie Mannor, Marco Pavone

Our first contribution is to show that a CVaR objective, besides capturing risk sensitivity, has an alternative interpretation as expected cost under worst-case modeling errors, for a given error budget.

Decision Making

Monte Carlo Motion Planning for Robot Trajectory Optimization Under Uncertainty

1 code implementation30 Apr 2015 Lucas Janson, Edward Schmerling, Marco Pavone

MCMP applies this CP estimation procedure to motion planning by iteratively (i) computing an (approximately) optimal path for the deterministic version of the problem (here, using the FMT* algorithm), (ii) computing the CP of this path, and (iii) inflating or deflating the obstacles by a common factor depending on whether the CP is higher or lower than a target value.

Robotics

Cannot find the paper you are looking for? You can Submit a new open access paper.