no code implementations • 21 Mar 2024 • Connor Lee, Saraswati Soedarmadji, Matthew Anderson, Anthony J. Clark, Soon-Jo Chung
We present a new method to automatically generate semantic segmentation annotations for thermal imagery captured from an aerial vehicle by utilizing satellite-derived data products alongside onboard global positioning and attitude estimates.
1 code implementation • 13 Mar 2024 • Connor Lee, Matthew Anderson, Nikhil Raganathan, Xingxing Zuo, Kevin Do, Georgia Gkioxari, Soon-Jo Chung
We present the first publicly available RGB-thermal dataset designed for aerial robotics operating in natural environments.
no code implementations • 28 Feb 2024 • Geeling Chau, Yujin An, Ahamed Raffey Iqbal, Soon-Jo Chung, Yisong Yue, Sabera Talukder
A major goal in neuroscience is to discover neural data representations that generalize.
1 code implementation • 30 Oct 2023 • Sri Aditya Deevi, Connor Lee, Lu Gan, Sushruth Nagesh, Gaurav Pandey, Soon-Jo Chung
Multimodal deep sensor fusion has the potential to enable autonomous vehicles to visually understand their surrounding environments in all weather conditions.
1 code implementation • 18 Jul 2023 • Connor Lee, Jonathan Gustafsson Frennert, Lu Gan, Matthew Anderson, Soon-Jo Chung
We present a new method to adapt an RGB-trained water segmentation network to target-domain aerial thermal imagery using online self-supervision by leveraging texture and motion cues as supervisory signals.
no code implementations • 13 Jul 2023 • Hiroyasu Tsukamoto, Benjamin Rivière, Changrak Choi, Amir Rahmani, Soon-Jo Chung
First, in a nominal setting, the analytical form of our CaRT safety filter formally ensures safe maneuvers of nonlinear multi-agent systems, optimally with minimal deviation from the learning-based policy.
no code implementations • 9 May 2023 • SooJean Han, Soon-Jo Chung, John C. Doyle
Incorporating pattern-learning for prediction (PLP) in many discrete-time or discrete-event systems allows for computation-efficient controller design by memorizing patterns to schedule control policies based on their future occurrences.
no code implementations • 26 Oct 2022 • Benjamin P. S. Donitz, Declan Mages, Hiroyasu Tsukamoto, Peter Dixon, Damon Landau, Soon-Jo Chung, Erica Bufanda, Michel Ingham, Julie Castillo-Rogez
Interstellar objects (ISOs) are fascinating and under-explored celestial objects, providing physical laboratories to understand the formation of our solar system and probe the composition and properties of material formed in exoplanetary systems.
1 code implementation • 9 Oct 2022 • Lu Gan, Connor Lee, Soon-Jo Chung
This work presents a new method for unsupervised thermal image classification and semantic segmentation by transferring knowledge from the RGB domain using a multi-domain attention network.
no code implementations • 9 Aug 2022 • Hiroyasu Tsukamoto, Soon-Jo Chung, Benjamin Donitz, Michel Ingham, Declan Mages, Yashwanth Kumar Nakka
In particular, it is used to construct a non-negative function with a supermartingale property, explicitly accounting for the ISO state uncertainty and the local nature of nonlinear state estimation guarantees.
1 code implementation • 13 May 2022 • Michael O'Connell, Guanya Shi, Xichen Shi, Kamyar Azizzadenesheli, Anima Anandkumar, Yisong Yue, Soon-Jo Chung
Last, our control design extrapolates to unseen wind conditions, is shown to be effective for outdoor flights with only onboard sensors, and can transfer across drones with minimal performance degradation.
no code implementations • 18 Dec 2021 • Daniel Neamati, Yashwanth Kumar Nakka, Soon-Jo Chung
Therefore, the training data domain should include spacecraft trajectories to accurately evaluate the learned model's safety and robustness.
no code implementations • 2 Oct 2021 • Hiroyasu Tsukamoto, Soon-Jo Chung, Jean-Jacques Slotine, Chuchu Fan
This paper presents a theoretical overview of a Neural Contraction Metric (NCM): a neural network model of an optimal contraction metric and corresponding differential Lyapunov function, the existence of which is a necessary and sufficient condition for incremental exponential stability of non-autonomous nonlinear system trajectories.
no code implementations • 1 Oct 2021 • Hiroyasu Tsukamoto, Soon-Jo Chung, Jean-Jacques E. Slotine
Contraction theory is an analytical tool to study differential dynamics of a non-autonomous (i. e., time-varying) nonlinear system under a contraction metric defined with a uniformly positive definite matrix, the existence of which results in a necessary and sufficient characterization of incremental exponential stability of multiple solution trajectories with respect to each other.
no code implementations • 22 Jul 2021 • SooJean Han, Soon-Jo Chung
We are motivated by the lack of discussion surrounding methodological control design procedures for nonlinear shot and L\'evy noise stochastic systems to propose a hierarchical controller synthesis method with two parts.
1 code implementation • NeurIPS 2021 • Guanya Shi, Kamyar Azizzadenesheli, Michael O'Connell, Soon-Jo Chung, Yisong Yue
We provide instantiations of our approach under varying conditions, leading to the first non-asymptotic end-to-end convergence guarantee for multi-task nonlinear control.
no code implementations • 5 Jun 2021 • Yashwanth Kumar Nakka, Soon-Jo Chung
We also present the predictor-corrector extension (gPC-SCP$^\mathrm{PC}$) for real-time motion trajectory generation in the presence of stochastic uncertainty.
no code implementations • 5 May 2021 • Benjamin Rivière, Soon-Jo Chung
We present H-TD2: Hybrid Temporal Difference Learning for Taxi Dispatch, a model-free, adaptive decision-making algorithm to coordinate a large fleet of automated taxis in a dynamic urban environment to minimize expected customer waiting times.
no code implementations • 24 Mar 2021 • SooJean Han, Soon-Jo Chung
The convergence rate for shot noise systems is the same as the exponentially-stable nominal system, but with a tradeoff between the parameters of the shot noise process and the size of the error ball.
no code implementations • 4 Mar 2021 • Hiroyasu Tsukamoto, Soon-Jo Chung, Jean-Jacques Slotine
Adaptive control is subject to stability and performance issues when a learned model is used to enhance its performance.
no code implementations • 2 Mar 2021 • Michael O'Connell, Guanya Shi, Xichen Shi, Soon-Jo Chung
We validate our approach by flying a drone in an open air wind tunnel under varying wind conditions and along challenging trajectories.
no code implementations • 25 Feb 2021 • Hiroyasu Tsukamoto, Soon-Jo Chung
This paper presents Learning-based Autonomous Guidance with RObustness and Stability guarantees (LAG-ROS), which provides machine learning-based nonlinear motion planners with formal robustness and stability guarantees, by designing a differential Lyapunov function using contraction theory.
no code implementations • 10 Dec 2020 • Guanya Shi, Wolfgang Hönig, Xichen Shi, Yisong Yue, Soon-Jo Chung
We present Neural-Swarm2, a learning-based method for motion planning and control that allows heterogeneous multirotors in a swarm to safely fly in close proximity.
no code implementations • NeurIPS 2020 • Chenkai Yu, Guanya Shi, Soon-Jo Chung, Yisong Yue, Adam Wierman
We study the impact of predictions in online Linear Quadratic Regulator control with both stochastic and adversarial disturbances in the dynamics.
1 code implementation • 6 Nov 2020 • Hiroyasu Tsukamoto, Soon-Jo Chung, Jean-Jacques E. Slotine
We present Neural Stochastic Contraction Metrics (NSCM), a new design framework for provably-stable robust control and estimation for a class of stochastic nonlinear systems.
4 code implementations • 8 Jun 2020 • Hiroyasu Tsukamoto, Soon-Jo Chung
This paper presents a new deep learning-based framework for robust nonlinear estimation and control using the concept of a Neural Contraction Metric (NCM).
2 code implementations • 8 Jun 2020 • Hiroyasu Tsukamoto, Soon-Jo Chung
For the sake of its sampling-based implementation, we present discrete-time stochastic contraction analysis with respect to a state- and time-dependent metric along with its explicit connection to continuous-time cases.
Systems and Control Robotics Systems and Control
no code implementations • 9 May 2020 • Yashwanth Kumar Nakka, Anqi Liu, Guanya Shi, Anima Anandkumar, Yisong Yue, Soon-Jo Chung
The Info-SNOC algorithm is used to compute a sub-optimal pool of safe motion plans that aid in exploration for learning unknown residual dynamics under safety constraints.
no code implementations • 6 Mar 2020 • Guanya Shi, Wolfgang Hönig, Yisong Yue, Soon-Jo Chung
We design a stable nonlinear tracking controller using the learned model.
1 code implementation • 26 Feb 2020 • Benjamin Rivière, Wolfgang Hoenig, Yisong Yue, Soon-Jo Chung
We present GLAS: Global-to-Local Autonomy Synthesis, a provably-safe, automated distributed policy generation for multi-robot motion planning.
Robotics
1 code implementation • NeurIPS 2020 • Guanya Shi, Yiheng Lin, Soon-Jo Chung, Yisong Yue, Adam Wierman
This paper presents competitive algorithms for a novel class of online optimization problems with memory.
no code implementations • L4DC 2020 • Anqi Liu, Guanya Shi, Soon-Jo Chung, Anima Anandkumar, Yisong Yue
To address this challenge, we present a deep robust regression model that is trained to directly predict the uncertainty bounds for safe exploration.
2 code implementations • 19 Nov 2018 • Guanya Shi, Xichen Shi, Michael O'Connell, Rose Yu, Kamyar Azizzadenesheli, Animashree Anandkumar, Yisong Yue, Soon-Jo Chung
To the best of our knowledge, this is the first DNN-based nonlinear feedback controller with stability guarantees that can utilize arbitrarily large neural nets.