Search Results for author: Steven L. Waslander

Found 38 papers, 13 papers with code

SmartRefine: A Scenario-Adaptive Refinement Framework for Efficient Motion Prediction

1 code implementation18 Mar 2024 Yang Zhou, Hao Shao, Letian Wang, Steven L. Waslander, Hongsheng Li, Yu Liu

Context information, such as road maps and surrounding agents' states, provides crucial geometric and semantic information for motion behavior prediction.

Autonomous Vehicles motion prediction

UncertaintyTrack: Exploiting Detection and Localization Uncertainty in Multi-Object Tracking

no code implementations19 Feb 2024 Chang Won Lee, Steven L. Waslander

Multi-object tracking (MOT) methods have seen a significant boost in performance recently, due to strong interest from the research community and steadily improving object detection methods.

Autonomous Driving Multi-Object Tracking +3

Feature Density Estimation for Out-of-Distribution Detection via Normalizing Flows

no code implementations9 Feb 2024 Evan D. Cook, Marc-Antoine Lavoie, Steven L. Waslander

This is a post-hoc method which can be applied to any pretrained model, and involves training a lightweight auxiliary normalizing flow model to perform the out-of-distribution detection via density thresholding.

Density Estimation Out-of-Distribution Detection +1

LMDrive: Closed-Loop End-to-End Driving with Large Language Models

1 code implementation12 Dec 2023 Hao Shao, Yuxuan Hu, Letian Wang, Steven L. Waslander, Yu Liu, Hongsheng Li

On the other hand, previous autonomous driving methods tend to rely on limited-format inputs (e. g. sensor data and navigation waypoints), restricting the vehicle's ability to understand language information and interact with humans.

Autonomous Driving Instruction Following

Multiple View Geometry Transformers for 3D Human Pose Estimation

no code implementations18 Nov 2023 Ziwei Liao, Jialiang Zhu, Chunyu Wang, Han Hu, Steven L. Waslander

In this work, we aim to improve the 3D reasoning ability of Transformers in multi-view 3D human pose estimation.

3D Human Pose Estimation

Uncertainty-aware 3D Object-Level Mapping with Deep Shape Priors

no code implementations17 Sep 2023 Ziwei Liao, Jun Yang, Jingxing Qian, Angela P. Schoellig, Steven L. Waslander

Unlike current state-of-the-art approaches, we explicitly model the uncertainty of the object shapes and poses during our optimization, resulting in a high-quality object-level mapping system.

3D Reconstruction Object

Multi-view 3D Object Reconstruction and Uncertainty Modelling with Neural Shape Prior

no code implementations17 Jun 2023 Ziwei Liao, Steven L. Waslander

We propose a method to model uncertainty as part of the representation and define an uncertainty-aware encoder which generates latent codes with uncertainty directly from individual input images.

3D Object Reconstruction Object +1

ReasonNet: End-to-End Driving with Temporal and Global Reasoning

no code implementations CVPR 2023 Hao Shao, Letian Wang, RuoBing Chen, Steven L. Waslander, Hongsheng Li, Yu Liu

The large-scale deployment of autonomous vehicles is yet to come, and one of the major remaining challenges lies in urban dense traffic scenarios.

Autonomous Driving

Efficient Reinforcement Learning for Autonomous Driving with Parameterized Skills and Priors

1 code implementation8 May 2023 Letian Wang, Jie Liu, Hao Shao, Wenshuo Wang, RuoBing Chen, Yu Liu, Steven L. Waslander

Inspired by this, we propose ASAP-RL, an efficient reinforcement learning algorithm for autonomous driving that simultaneously leverages motion skills and expert priors.

Autonomous Driving reinforcement-learning

Gradient-based Maximally Interfered Retrieval for Domain Incremental 3D Object Detection

1 code implementation27 Apr 2023 Barza Nisar, Hruday Vishal Kanna Anand, Steven L. Waslander

Accurate 3D object detection in all weather conditions remains a key challenge to enable the widespread deployment of autonomous vehicles, as most work to date has been performed on clear weather data.

3D Object Detection Autonomous Vehicles +3

HyperMODEST: Self-Supervised 3D Object Detection with Confidence Score Filtering

1 code implementation27 Apr 2023 Jenny Xu, Steven L. Waslander

Current LiDAR-based 3D object detectors for autonomous driving are almost entirely trained on human-annotated data collected in specific geographical domains with specific sensor setups, making it difficult to adapt to a different domain.

3D Object Detection Autonomous Driving +2

Self-Supervised Image-to-Point Distillation via Semantically Tolerant Contrastive Loss

no code implementations CVPR 2023 Anas Mahmoud, Jordan S. K. Hu, Tianshu Kuai, Ali Harakeh, Liam Paull, Steven L. Waslander

However, image-to point representation learning for autonomous driving datasets faces two main challenges: 1) the abundance of self-similarity, which results in the contrastive losses pushing away semantically similar point and image regions and thus disturbing the local semantic structure of the learned representations, and 2) severe class imbalance as pretraining gets dominated by over-represented classes.

3D Semantic Segmentation Autonomous Driving +4

Estimating Regression Predictive Distributions with Sample Networks

no code implementations24 Nov 2022 Ali Harakeh, Jordan Hu, Naiqing Guan, Steven L. Waslander, Liam Paull

A common approach to model uncertainty is to choose a parametric distribution and fit the data to it using maximum likelihood estimation.

regression

InterTrack: Interaction Transformer for 3D Multi-Object Tracking

no code implementations17 Aug 2022 John Willes, Cody Reading, Steven L. Waslander

We then perform a learned regression on each track/detection feature pair to estimate affinities, and use a robust two-stage data association and track management approach to produce the final tracks.

3D Multi-Object Tracking Autonomous Vehicles +3

Dense Voxel Fusion for 3D Object Detection

no code implementations2 Mar 2022 Anas Mahmoud, Jordan S. K. Hu, Steven L. Waslander

Sequential fusion methods suffer from a limited number of pixel and point correspondences due to point cloud sparsity, or their performance is strictly capped by the detections of one of the modalities.

3D Object Detection Object +1

Next-Best-View Prediction for Active Stereo Cameras and Highly Reflective Objects

no code implementations27 Feb 2022 Jun Yang, Steven L. Waslander

Depth acquisition with the active stereo camera is a challenging task for highly reflective objects.

Depth Completion Pose Estimation

Pattern-Aware Data Augmentation for LiDAR 3D Object Detection

no code implementations30 Nov 2021 Jordan S. K. Hu, Steven L. Waslander

Autonomous driving datasets are often skewed and in particular, lack training data for objects at farther distances from the ego vehicle.

3D Object Detection Autonomous Driving +3

Temporal Convolutions for Multi-Step Quadrotor Motion Prediction

no code implementations8 Oct 2021 Samuel Looper, Steven L. Waslander

Model-based control methods for robotic systems such as quadrotors, autonomous driving vehicles and flexible manipulators require motion models that generate accurate predictions of complex nonlinear system dynamics over long periods of time.

Autonomous Driving motion prediction

Estimating and Evaluating Regression Predictive Uncertainty in Deep Object Detectors

3 code implementations13 Jan 2021 Ali Harakeh, Steven L. Waslander

We show that in the context of object detection, training variance networks with negative log likelihood (NLL) can lead to high entropy predictive distributions regardless of the correctness of the output mean.

Object object-detection +3

Predictive Uncertainty in Deep Object Detectors: Estimation and Evaluation

no code implementations ICLR 2021 Ali Harakeh, Steven L. Waslander

We show that in the context of object detection, training variance networks with negative log likelihood (NLL) can lead to high entropy predictive distributions regardless of the correctness of the output mean.

Object object-detection +2

Confidence Guided Stereo 3D Object Detection with Split Depth Estimation

no code implementations11 Mar 2020 Chengyao Li, Jason Ku, Steven L. Waslander

To tackle these two issues, we propose CG-Stereo, a confidence-guided stereo 3D object detection pipeline that uses separate decoders for foreground and background pixels during depth estimation, and leverages the confidence estimation from the depth estimation network as a soft attention mechanism in the 3D object detector.

3D Object Detection From Stereo Images Autonomous Driving +3

Visual Measurement Integrity Monitoring for UAV Localization

no code implementations18 Sep 2019 Chengyao Li, Steven L. Waslander

In this paper, we propose a novel approach inspired by RAIM to monitor the integrity of optimization-based visual localization and calculate the protection level of a state estimate, i. e. the largest possible translational error in each direction.

Visual Localization

Object-Centric Stereo Matching for 3D Object Detection

no code implementations17 Sep 2019 Alex D. Pon, Jason Ku, Chengyao Li, Steven L. Waslander

The issue with existing stereo matching networks is that they are designed for disparity estimation, not 3D object detection; the shape and accuracy of object point clouds are not the focus.

3D Object Detection From Stereo Images Autonomous Driving +5

Improving 3D Object Detection for Pedestrians with Virtual Multi-View Synthesis Orientation Estimation

no code implementations15 Jul 2019 Jason Ku, Alex D. Pon, Sean Walsh, Steven L. Waslander

Accurately estimating the orientation of pedestrians is an important and challenging task for autonomous driving because this information is essential for tracking and predicting pedestrian behavior.

3D Object Detection Autonomous Driving +2

BayesOD: A Bayesian Approach for Uncertainty Estimation in Deep Object Detectors

2 code implementations9 Mar 2019 Ali Harakeh, Michael Smart, Steven L. Waslander

When incorporating deep neural networks into robotic systems, a major challenge is the lack of uncertainty measures associated with their output predictions.

Object object-detection +1

Network Uncertainty Informed Semantic Feature Selection for Visual SLAM

1 code implementation29 Nov 2018 Pranav Ganti, Steven L. Waslander

In order to facilitate long-term localization using a visual simultaneous localization and mapping (SLAM) algorithm, careful feature selection can help ensure that reference points persist over long durations and the runtime and storage complexity of the algorithm remain consistent.

feature selection Semantic Segmentation +2

Encoderless Gimbal Calibration of Dynamic Multi-Camera Clusters

no code implementations24 Jul 2018 Christopher L. Choi, Jason Rebello, Leonid Koppel, Pranav Ganti, Arun Das, Steven L. Waslander

In this paper, we present an encoderless approach for DCC calibration which simultaneously estimates the kinematic parameters of the transformation chain as well as the unknown joint angles.

Leveraging Pre-Trained 3D Object Detection Models For Fast Ground Truth Generation

no code implementations16 Jul 2018 Jungwook Lee, Sean Walsh, Ali Harakeh, Steven L. Waslander

Training 3D object detectors for autonomous driving has been limited to small datasets due to the effort required to generate annotations.

3D Object Detection Autonomous Driving +5

A Hierarchical Deep Architecture and Mini-Batch Selection Method For Joint Traffic Sign and Light Detection

2 code implementations20 Jun 2018 Alex D. Pon, Oles Andrienko, Ali Harakeh, Steven L. Waslander

The root cause of this issue is that no public dataset contains both traffic light and sign labels, which leads to difficulties in developing a joint detection framework.

Traffic Sign Detection Traffic Sign Recognition

Multi-Step Prediction of Dynamic Systems with Recurrent Neural Networks

no code implementations20 May 2018 Nima Mohajerin, Steven L. Waslander

In this work, the state initialization problem is addressed using Neural Networks (NNs) to effectively train a variety of RNNs for modeling two aerial vehicles, a helicopter and a quadrotor, from experimental data.

In Defense of Classical Image Processing: Fast Depth Completion on the CPU

2 code implementations31 Jan 2018 Jason Ku, Ali Harakeh, Steven L. Waslander

With the rise of data driven deep neural networks as a realization of universal function approximators, most research on computer vision problems has moved away from hand crafted classical image processing algorithms.

Depth Completion

3D Scan Registration using Curvelet Features in Planetary Environments

no code implementations23 Sep 2015 Siddhant Ahuja, Peter Iles, Steven L. Waslander

Topographic mapping in planetary environments relies on accurate 3D scan registration methods.

Degenerate Motions in Multicamera Cluster SLAM with Non-overlapping Fields of View

no code implementations25 Jun 2015 Michael J. Tribou, David W. L. Wang, Steven L. Waslander

An analysis of the relative motion and point feature model configurations leading to solution degeneracy is presented, for the case of a Simultaneous Localization and Mapping system using multicamera clusters with non-overlapping fields-of-view.

Simultaneous Localization and Mapping

Cannot find the paper you are looking for? You can Submit a new open access paper.