Search Results for author: Klaus Dietmayer

Found 71 papers, 29 papers with code

The Radar Ghost Dataset -- An Evaluation of Ghost Objects in Automotive Radar Data

no code implementations1 Apr 2024 Florian Kraus, Nicolas Scheiner, Werner Ritter, Klaus Dietmayer

In this article, we present a dataset with detailed manual annotations for different kinds of ghost detections.

Autonomous Vehicles

Simultaneous Clutter Detection and Semantic Segmentation of Moving Objects for Automotive Radar Data

no code implementations13 Nov 2023 Johannes Kopp, Dominik Kellner, Aldi Piroli, Vinzenz Dallabetta, Klaus Dietmayer

The unique properties of radar sensors, such as their robustness to adverse weather conditions, make them an important part of the environment perception system of autonomous vehicles.

Autonomous Vehicles Semantic Segmentation

Multimodal Object Query Initialization for 3D Object Detection

no code implementations16 Oct 2023 Mathijs R. van Geerenstein, Felicia Ruppel, Klaus Dietmayer, Dariu M. Gavrila

In experiments, we outperform the state of the art in transformer-based LiDAR object detection on the competitive nuScenes benchmark and showcase the benefits of input-dependent multimodal query initialization, while being more efficient than the available alternatives for LiDAR-camera initialization.

3D Object Detection Autonomous Driving +2

Towards Robust 3D Object Detection In Rainy Conditions

no code implementations2 Oct 2023 Aldi Piroli, Vinzenz Dallabetta, Johannes Kopp, Marc Walessa, Daniel Meissner, Klaus Dietmayer

In this way, the detected objects are less affected by the adverse weather in the scene, resulting in a more accurate perception of the environment.

Autonomous Driving Object +2

Group Regression for Query Based Object Detection and Tracking

no code implementations28 Aug 2023 Felicia Ruppel, Florian Faion, Claudius Gläser, Klaus Dietmayer

We show that the proposed method is applicable to many existing transformer based perception approaches and can bring potential benefits.

3D Object Detection Autonomous Driving +3

Data-Free Backbone Fine-Tuning for Pruned Neural Networks

1 code implementation22 Jun 2023 Adrian Holzbock, Achyut Hegde, Klaus Dietmayer, Vasileios Belagiannis

In particular, the pruned network backbone is trained with synthetically generated images, and our proposed intermediate supervision to mimic the unpruned backbone's output feature map.

2D Human Pose Estimation Image Classification +4

RT-K-Net: Revisiting K-Net for Real-Time Panoptic Segmentation

1 code implementation2 May 2023 Markus Schön, Michael Buchholz, Klaus Dietmayer

Our resulting RT-K-Net sets a new state-of-the-art performance for real-time panoptic segmentation methods on the Cityscapes dataset and shows promising results on the challenging Mapillary Vistas dataset.

Instance Segmentation Panoptic Segmentation +2

LMR: Lane Distance-Based Metric for Trajectory Prediction

1 code implementation12 Apr 2023 Julian Schmidt, Thomas Monninger, Julian Jordan, Klaus Dietmayer

In contrast to the Euclidean Miss Rate, qualitative results show that LMR yields misses for sequences where predictions are located on wrong lanes.

Trajectory Prediction

RESET: Revisiting Trajectory Sets for Conditional Behavior Prediction

no code implementations12 Apr 2023 Julian Schmidt, Pascal Huissel, Julian Wiederer, Julian Jordan, Vasileios Belagiannis, Klaus Dietmayer

It is desirable to predict the behavior of traffic participants conditioned on different planned trajectories of the autonomous vehicle.

regression Trajectory Prediction

Tackling Clutter in Radar Data -- Label Generation and Detection Using PointNet++

1 code implementation16 Mar 2023 Johannes Kopp, Dominik Kellner, Aldi Piroli, Klaus Dietmayer

Because there is no suitable public data set in which clutter is annotated, we design a method to automatically generate the respective labels.

Autonomous Vehicles object-detection +1

Gesture Recognition with Keypoint and Radar Stream Fusion for Automated Vehicles

no code implementations20 Feb 2023 Adrian Holzbock, Nicolai Kern, Christian Waldschmidt, Klaus Dietmayer, Vasileios Belagiannis

We present a joint camera and radar approach to enable autonomous vehicles to understand and react to human gestures in everyday traffic.

Autonomous Vehicles Gesture Recognition

Exploring Navigation Maps for Learning-Based Motion Prediction

1 code implementation13 Feb 2023 Julian Schmidt, Julian Jordan, Franz Gritschneder, Thomas Monninger, Klaus Dietmayer

Combined with our method for knowledge distillation, we achieve results that are close to the original HD map-reliant models.

Autonomous Driving Knowledge Distillation +1

SCENE: Reasoning about Traffic Scenes using Heterogeneous Graph Neural Networks

1 code implementation9 Jan 2023 Thomas Monninger, Julian Schmidt, Jan Rupprecht, David Raba, Julian Jordan, Daniel Frank, Steffen Staab, Klaus Dietmayer

In this work we propose SCENE, a methodology to encode diverse traffic scenes in heterogeneous graphs and to reason about these graphs using a heterogeneous Graph Neural Network encoder and task-specific decoders.

Knowledge Graphs Node Classification

Transformers for Object Detection in Large Point Clouds

no code implementations30 Sep 2022 Felicia Ruppel, Florian Faion, Claudius Gläser, Klaus Dietmayer

We present TransLPC, a novel detection model for large point clouds that is based on a transformer architecture.

Autonomous Driving Multi-Object Tracking +3

MotionMixer: MLP-based 3D Human Body Pose Forecasting

1 code implementation1 Jul 2022 Arij Bouazizi, Adrian Holzbock, Ulrich Kressel, Klaus Dietmayer, Vasileios Belagiannis

Given a stacked sequence of 3D body poses, a spatial-MLP extracts fine grained spatial dependencies of the body joints.

Human Pose Forecasting

MGNet: Monocular Geometric Scene Understanding for Autonomous Driving

2 code implementations ICCV 2021 Markus Schön, Michael Buchholz, Klaus Dietmayer

We define monocular geometric scene understanding as the combination of two known tasks: Panoptic segmentation and self-supervised monocular depth estimation.

Autonomous Driving Monocular Depth Estimation +2

Self-Assessment for Single-Object Tracking in Clutter Using Subjective Logic

no code implementations15 Jun 2022 Thomas Griebel, Johannes Müller, Paul Geisler, Charlotte Hermann, Martin Herrmann, Michael Buchholz, Klaus Dietmayer

Therefore, this work presents a novel method for self-assessment of single-object tracking in clutter based on Kalman filtering and subjective logic.

Decision Making Object Tracking

MEAT: Maneuver Extraction from Agent Trajectories

no code implementations10 Jun 2022 Julian Schmidt, Julian Jordan, David Raba, Tobias Welz, Klaus Dietmayer

Additionally, an analysis of the datasets and an evaluation of the prediction models based on the agent dynamics is provided.

Trajectory Prediction

Transformers for Multi-Object Tracking on Point Clouds

no code implementations31 May 2022 Felicia Ruppel, Florian Faion, Claudius Gläser, Klaus Dietmayer

The model utilizes a cross- and a self-attention mechanism and is applicable to lidar data in an automotive context, as well as other data types, such as radar.

Management Multi-Object Tracking +1

Robust 3D Object Detection in Cold Weather Conditions

no code implementations24 May 2022 Aldi Piroli, Vinzenz Dallabetta, Marc Walessa, Daniel Meissner, Johannes Kopp, Klaus Dietmayer

Second, we introduce a point cloud augmentation process that can be used to add gas exhaust to datasets recorded in good weather conditions.

Data Augmentation Object +3

CRAT-Pred: Vehicle Trajectory Prediction with Crystal Graph Convolutional Neural Networks and Multi-Head Self-Attention

1 code implementation9 Feb 2022 Julian Schmidt, Julian Jordan, Franz Gritschneder, Klaus Dietmayer

We therefore propose CRAT-Pred, a multi-modal and non-rasterization-based trajectory prediction model, specifically designed to effectively model social interactions between vehicles, without relying on map information.

Autonomous Vehicles Motion Forecasting +1

Globally Optimal Multi-Scale Monocular Hand-Eye Calibration Using Dual Quaternions

1 code implementation12 Jan 2022 Thomas Wodtko, Markus Horn, Michael Buchholz, Klaus Dietmayer

In this work, we present an approach for monocular hand-eye calibration from per-sensor ego-motion based on dual quaternions.

Translation

Fast Rule-Based Clutter Detection in Automotive Radar Data

no code implementations27 Aug 2021 Johannes Kopp, Dominik Kellner, Aldi Piroli, Klaus Dietmayer

Each of these effects is described both theoretically and regarding a method for identifying the corresponding clutter detections.

object-detection Object Detection

GenRadar: Self-supervised Probabilistic Camera Synthesis based on Radar Frequencies

1 code implementation19 Jul 2021 Carsten Ditzel, Klaus Dietmayer

Autonomous systems require a continuous and dependable environment perception for navigation and decision-making, which is best achieved by combining different sensor types.

Decision Making Self-Learning

Motion Classification and Height Estimation of Pedestrians Using Sparse Radar Data

no code implementations3 Mar 2021 Markus Horn, Ole Schumann, Markus Hahn, Jürgen Dickmann, Klaus Dietmayer

A complete overview of the surrounding vehicle environment is important for driver assistance systems and highly autonomous driving.

Autonomous Driving General Classification

Online Extrinsic Calibration based on Per-Sensor Ego-Motion Using Dual Quaternions

1 code implementation27 Jan 2021 Markus Horn, Thomas Wodtko, Michael Buchholz, Klaus Dietmayer

Further, our online calibration approach is tested on the KITTI odometry dataset, which provides data of a lidar and two stereo camera systems mounted on a vehicle.

Robotics

Labels Are Not Perfect: Inferring Spatial Uncertainty in Object Detection

no code implementations18 Dec 2020 Di Feng, Zining Wang, Yiyang Zhou, Lars Rosenbaum, Fabian Timm, Klaus Dietmayer, Masayoshi Tomizuka, Wei Zhan

As a result, an in-depth evaluation among different object detection methods remains challenging, and the training process of object detectors is sub-optimal, especially in probabilistic object detection.

Autonomous Driving Object +2

A Review and Comparative Study on Probabilistic Object Detection in Autonomous Driving

1 code implementation20 Nov 2020 Di Feng, Ali Harakeh, Steven Waslander, Klaus Dietmayer

Next, we present a strict comparative study for probabilistic object detection based on an image detector and three public autonomous driving datasets.

Autonomous Driving Object +2

Point Transformer

2 code implementations2 Nov 2020 Nico Engel, Vasileios Belagiannis, Klaus Dietmayer

In this work, we present Point Transformer, a deep neural network that operates directly on unordered and unstructured point sets.

3D Object Classification 3D Part Segmentation

Using Machine Learning to Detect Ghost Images in Automotive Radar

no code implementations10 Jul 2020 Florian Kraus, Nicolas Scheiner, Werner Ritter, Klaus Dietmayer

We show that we can use a state-of-the-art automotive radar classifier in order to detect ghost objects alongside real objects.

BIG-bench Machine Learning

Robust Semantic Segmentation in Adverse Weather Conditions by means of Fast Video-Sequence Segmentation

1 code implementation1 Jul 2020 Andreas Pfeuffer, Klaus Dietmayer

Computer vision tasks such as semantic segmentation perform very well in good weather conditions, but if the weather turns bad, they have problems to achieve this performance in these conditions.

Image Segmentation Segmentation +3

Kalman Filter Meets Subjective Logic: A Self-Assessing Kalman Filter Using Subjective Logic

no code implementations1 Jul 2020 Thomas Griebel, Johannes Müller, Michael Buchholz, Klaus Dietmayer

Thus, by embedding classical Kalman filtering into subjective logic, our method additionally features an explicit measure for statistical uncertainty in the self-assessment.

Uncertainty depth estimation with gated images for 3D reconstruction

no code implementations11 Mar 2020 Stefanie Walz, Tobias Gruber, Werner Ritter, Klaus Dietmayer

Gated imaging is an emerging sensor technology for self-driving cars that provides high-contrast images even under adverse weather influence.

3D Reconstruction Depth Completion +2

Inferring Spatial Uncertainty in Object Detection

no code implementations7 Mar 2020 Zining Wang, Di Feng, Yiyang Zhou, Lars Rosenbaum, Fabian Timm, Klaus Dietmayer, Masayoshi Tomizuka, Wei Zhan

Based on the spatial distribution, we further propose an extension of IoU, called the Jaccard IoU (JIoU), as a new evaluation metric that incorporates label uncertainty.

Autonomous Driving Object +2

Leveraging Uncertainties for Deep Multi-modal Object Detection in Autonomous Driving

no code implementations1 Feb 2020 Di Feng, Yifan Cao, Lars Rosenbaum, Fabian Timm, Klaus Dietmayer

This work presents a probabilistic deep neural network that combines LiDAR point clouds and RGB camera images for robust, accurate 3D object detection.

3D Object Detection Autonomous Driving +2

Seeing Around Street Corners: Non-Line-of-Sight Detection and Tracking In-the-Wild Using Doppler Radar

1 code implementation CVPR 2020 Nicolas Scheiner, Florian Kraus, Fangyin Wei, Buu Phan, Fahim Mannan, Nils Appenrodt, Werner Ritter, Jürgen Dickmann, Klaus Dietmayer, Bernhard Sick, Felix Heide

In this work, we depart from visible-wavelength approaches and demonstrate detection, classification, and tracking of hidden objects in large-scale dynamic environments using Doppler radars that can be manufactured at low-cost in series production.

Temporal Sequences

Learning Super-resolved Depth from Active Gated Imaging

no code implementations5 Dec 2019 Tobias Gruber, Mariia Kokhova, Werner Ritter, Norbert Haala, Klaus Dietmayer

Environment perception for autonomous driving is doomed by the trade-off between range-accuracy and resolution: current sensors that deliver very precise depth information are usually restricted to low resolution because of technology or cost limitations.

Autonomous Driving

Separable Convolutional LSTMs for Faster Video Segmentation

1 code implementation16 Jul 2019 Andreas Pfeuffer, Klaus Dietmayer

The advantage of video segmentation approaches compared to single image segmentation is that temporal image information is considered, and their performance increases due to this.

Image Segmentation Segmentation +4

Pixel-Accurate Depth Evaluation in Realistic Driving Scenarios

1 code implementation21 Jun 2019 Tobias Gruber, Mario Bijelic, Felix Heide, Werner Ritter, Klaus Dietmayer

This work introduces an evaluation benchmark for depth estimation and completion using high-resolution depth measurements with angular resolution of up to 25" (arcsecond), akin to a 50 megapixel camera with per-pixel depth available.

Depth Estimation

Robust Semantic Segmentation in Adverse Weather Conditions by means of Sensor Data Fusion

no code implementations24 May 2019 Andreas Pfeuffer, Klaus Dietmayer

One possibility to still obtain reliable results is to observe the environment with different sensor types, such as camera and lidar, and to fuse the sensor data by means of neural networks, since different sensors behave differently in diverse weather conditions.

Semantic Segmentation Sensor Fusion

Uncertainty Estimation in One-Stage Object Detection

1 code implementation24 May 2019 Florian Kraus, Klaus Dietmayer

Environment perception is the task for intelligent vehicles on which all subsequent steps rely.

Object object-detection +2

Training a Fast Object Detector for LiDAR Range Images Using Labeled Data from Sensors with Higher Resolution

no code implementations8 May 2019 Manuel Herzog, Klaus Dietmayer

We use an existing annotated dataset to train a neural network that can be used with a LiDAR sensor that has a lower resolution than the one used for recording the annotated dataset.

Object object-detection +2

Semantic Segmentation of Video Sequences with Convolutional LSTMs

1 code implementation3 May 2019 Andreas Pfeuffer, Karina Schulz, Klaus Dietmayer

The disadvantage of this is that temporal image information is not considered, which improves the performance of the segmentation approach.

Image Segmentation Position +4

DeepLocalization: Landmark-based Self-Localization with Deep Neural Networks

no code implementations18 Apr 2019 Nico Engel, Stefan Hoermann, Markus Horn, Vasileios Belagiannis, Klaus Dietmayer

The map is generated off-line by extracting landmarks from the vehicle's field of view, while the measurements are collected similarly on the fly.

Translation

2D Car Detection in Radar Data with PointNets

no code implementations17 Apr 2019 Andreas Danzer, Thomas Griebel, Martin Bach, Klaus Dietmayer

To this end, PointNets are adjusted for radar data performing 2D object classification with segmentation, and 2D bounding box regression in order to estimate an amodal 2D bounding box.

Classification General Classification +3

Seeing Through Fog Without Seeing Fog: Deep Multimodal Sensor Fusion in Unseen Adverse Weather

1 code implementation CVPR 2020 Mario Bijelic, Tobias Gruber, Fahim Mannan, Florian Kraus, Werner Ritter, Klaus Dietmayer, Felix Heide

The fusion of multimodal sensor streams, such as camera, lidar, and radar measurements, plays a critical role in object detection for autonomous vehicles, which base their decision making on these inputs.

Autonomous Vehicles Decision Making +3

Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challenges

1 code implementation21 Feb 2019 Di Feng, Christian Haase-Schuetz, Lars Rosenbaum, Heinz Hertlein, Claudius Glaeser, Fabian Timm, Werner Wiesbeck, Klaus Dietmayer

This review paper attempts to systematically summarize methodologies and discuss challenges for deep multi-modal object detection and semantic segmentation in autonomous driving.

Robotics

Gated2Depth: Real-time Dense Lidar from Gated Images

2 code implementations ICCV 2019 Tobias Gruber, Frank Julca-Aguilar, Mario Bijelic, Werner Ritter, Klaus Dietmayer, Felix Heide

The proposed replacement for scanning lidar systems is real-time, handles back-scatter and provides dense depth at long ranges.

Scene Understanding

Long-Term Occupancy Grid Prediction Using Recurrent Neural Networks

no code implementations11 Sep 2018 Marcel Schreiber, Stefan Hoermann, Klaus Dietmayer

We tackle the long-term prediction of scene evolution in a complex downtown scenario for automated driving based on Lidar grid fusion and recurrent neural networks (RNNs).

Optimal Sensor Data Fusion Architecture for Object Detection in Adverse Weather Conditions

no code implementations6 Jul 2018 Andreas Pfeuffer, Klaus Dietmayer

In this work, different sensor fusion architectures are compared for good and adverse weather conditions for finding the optimal fusion architecture for diverse weather situations.

Object object-detection +2

Disparity Sliding Window: Object Proposals From Disparity Images

1 code implementation17 May 2018 Julian Müller, Andreas Fregin, Klaus Dietmayer

A mathematical derivation clarifies the number of object candidates with respect to parameters such as image and object size.

Object object-detection +3

Detecting Traffic Lights by Single Shot Detection

2 code implementations7 May 2018 Julian Müller, Klaus Dietmayer

So far, research in traffic light detection mainly focused on hand-crafted features, such as color, shape or brightness of the traffic light bulb.

object-detection Object Detection

Towards Safe Autonomous Driving: Capture Uncertainty in the Deep Neural Network For Lidar 3D Vehicle Detection

no code implementations13 Apr 2018 Di Feng, Lars Rosenbaum, Klaus Dietmayer

Experimental results show that the epistemic uncertainty is related to the detection accuracy, whereas the aleatoric uncertainty is influenced by vehicle distance and occlusion.

Autonomous Driving General Classification +3

Offline Object Extraction from Dynamic Occupancy Grid Map Sequences

no code implementations11 Apr 2018 Daniel Stumper, Fabian Gies, Stefan Hoermann, Klaus Dietmayer

The evaluation of algorithms for object extraction or the training and validation of learning algorithms rely on labeled ground truth data.

Object

Intentions of Vulnerable Road Users - Detection and Forecasting by Means of Machine Learning

no code implementations9 Mar 2018 Michael Goldhammer, Sebastian Köhler, Stefan Zernetsch, Konrad Doll, Bernhard Sick, Klaus Dietmayer

Furthermore, the architecture is used to evaluate motion-specific physical models for starting and stopping and video-based pedestrian motion classification.

BIG-bench Machine Learning General Classification +1

Tracking Multiple Vehicles Using a Variational Radar Model

1 code implementation10 Nov 2017 Alexander Scheel, Klaus Dietmayer

Yet, the increased amount of data raises the demands on tracking modules: measurement models that are able to process multiple measurements for an object are necessary and measurement-to-object associations become more complex.

Signal Processing Robotics Computation

Cannot find the paper you are looking for? You can Submit a new open access paper.