no code implementations • 3 Mar 2023 • Marvin Klingner, Shubhankar Borse, Varun Ravi Kumar, Behnaz Rezaei, Venkatraman Narayanan, Senthil Yogamani, Fatih Porikli
Specifically, we propose cross-task distillation from an instance segmentation teacher (X-IS) in the PV feature extraction stage providing supervision without ambiguous error backpropagation through the view transformation.
no code implementations • 11 Jan 2023 • Shihao Shen, Louis Kerofsky, Senthil Yogamani
Optical flow estimation is a well-studied topic for automated driving applications.
no code implementations • 13 Oct 2022 • Shubhankar Borse, Marvin Klingner, Varun Ravi Kumar, Hong Cai, Abdulaziz Almuzairee, Senthil Yogamani, Fatih Porikli
Bird's-eye-view (BEV) grid is a common representation for the perception of road components, e. g., drivable area, in autonomous driving.
no code implementations • 26 Jun 2022 • Saravanabalagi Ramachandran, Ganesh Sistu, Varun Ravi Kumar, John McDonald, Senthil Yogamani
Object detection is a comprehensively studied problem in autonomous driving.
no code implementations • 25 Jun 2022 • Sugirtha T, Sridevi M, Khailash Santhakumar, Hao liu, B Ravi Kiran, Thomas Gauthier, Senthil Yogamani
We evaluate the pretext task using the RTM3D detection model as baseline, with and without the application of data augmentation.
no code implementations • 6 Jun 2022 • Sambit Mohapatra, Thomas Mesquida, Mona Hodaei, Senthil Yogamani, Heinrich Gotzig, Patrick Mader
Spiking Neural Networks are a recent and new neural network design approach that promises tremendous improvements in power efficiency, computation efficiency, and processing latency.
1 code implementation • 31 May 2022 • Pramit Dutta, Ganesh Sistu, Senthil Yogamani, Edgar Galván, John McDonald
In this paper, we evaluate the use of vision transformers (ViT) as a backbone architecture to generate BEV maps.
no code implementations • 26 May 2022 • Varun Ravi Kumar, Ciaran Eising, Christian Witt, Senthil Yogamani
Surround-view fisheye cameras are commonly used for near-field sensing in automated driving.
no code implementations • 4 May 2022 • Fergal Stapleton, Edgar Galván, Ganesh Sistu, Senthil Yogamani
The incentive for using Evolutionary Algorithms (EAs) for the automated optimization and training of deep neural networks (DNNs), a process referred to as neuroevolution, has gained momentum in recent years.
no code implementations • 29 Mar 2022 • Subhrajyoti Dasgupta, Arindam Das, Sudip Das, Andrei Bursuc, Ujjwal Bhattacharya, Senthil Yogamani
Shadows are frequently encountered natural phenomena that significantly hinder the performance of computer vision perception systems in practical settings, e. g., autonomous driving.
no code implementations • 9 Mar 2022 • Ahmed Rida Sekkat, Yohan Dupuis, Varun Ravi Kumar, Hazem Rashed, Senthil Yogamani, Pascal Vasseur, Paul Honeine
In this work, we release a synthetic version of the surround-view dataset, covering many of its weaknesses and extending it.
1 code implementation • 2 Mar 2022 • Marvin Klingner, Varun Ravi Kumar, Senthil Yogamani, Andreas Bär, Tim Fingscheidt
In this paper, we (i) propose a novel adversarial perturbation detection scheme based on multi-task perception of complex vision tasks (i. e., depth estimation and semantic segmentation).
no code implementations • 8 Nov 2021 • Sambit Mohapatra, Mona Hodaei, Senthil Yogamani, Stefan Milz, Heinrich Gotzig, Martin Simon, Hazem Rashed, Patrick Maeder
To the best of our knowledge, this is the first work directly performing motion segmentation in LiDAR BEV space.
1 code implementation • 17 Aug 2021 • Louis Gallagher, Varun Ravi Kumar, Senthil Yogamani, John B. McDonald
In this paper, we present a system for incrementally reconstructing a dense 3D model of the geometry of an outdoor environment using a single monocular camera attached to a moving vehicle.
no code implementations • 17 Jul 2021 • Saravanabalagi Ramachandran, Ganesh Sistu, John McDonald, Senthil Yogamani
This challenge served as a medium to investigate the challenges and new methodologies to handle the complexities with perception on fisheye images.
no code implementations • 15 Jul 2021 • Ibrahim Sobh, Ahmed Hamed, Varun Ravi Kumar, Senthil Yogamani
On the other hand, current deep neural networks are easily fooled by adversarial attacks.
no code implementations • 11 Jul 2021 • Hazem Rashed, Mariam Essam, Maha Mohamed, Ahmad El Sallab, Senthil Yogamani
In this work, we explore end-to-end Moving Object Detection (MOD) on the BEV map directly using monocular images as input.
no code implementations • 26 May 2021 • Ashok Dahal, Varun Ravi Kumar, Senthil Yogamani, Ciaran Eising
In this work, we propose a system based on the surround-view camera architecture to detect, localize, and automatically align the vehicle with the inductive chargepad.
no code implementations • 26 May 2021 • Kinjal Dasgupta, Arindam Das, Sudip Das, Ujjwal Bhattacharya, Senthil Yogamani
Fusion of these two encoded features takes place inside a multimodal feature embedding module (MuFEm) consisting of several groups of a pair of Graph Attention Network and a feature fusion unit.
no code implementations • 17 May 2021 • Michal Uricar, Ganesh Sistu, Lucie Yahiaoui, Senthil Yogamani
Manual annotation of soiling on surround view cameras is a very challenging and expensive task.
no code implementations • 28 Apr 2021 • Mahesh M Dhananjaya, Varun Ravi Kumar, Senthil Yogamani
There is no public dataset for weather and light level classification focused on autonomous driving to the best of our knowledge.
no code implementations • 26 Apr 2021 • Markus Heimberger, Jonathan Horgan, Ciaran Hughes, John McDonald, Senthil Yogamani
In this paper, we discuss the design and implementation of an automated parking system from the perspective of computer vision algorithms.
no code implementations • 26 Apr 2021 • Jonathan Horgan, Ciarán Hughes, John McDonald, Senthil Yogamani
Vision-based driver assistance systems is one of the rapidly growing research areas of ITS, due to various factors such as the increased level of safety requirements in automotive, computational power in embedded systems, and desire to get closer to autonomous driving.
no code implementations • 22 Apr 2021 • Hazem Rashed, Ahmad El Sallab, Senthil Yogamani
In this work, we aim to leverage the vehicle motion information and feed it into the model to have an adaptation mechanism based on ego-motion.
no code implementations • 21 Apr 2021 • Sambit Mohapatra, Senthil Yogamani, Heinrich Gotzig, Stefan Milz, Patrick Mader
Most of the research is focused on achieving higher accuracy and these models are not optimized for deployment on embedded systems from the perspective of latency and power efficiency.
no code implementations • 21 Apr 2021 • Sugirtha T, Sridevi M, Khailash Santhakumar, B Ravi Kiran, Thomas Gauthier, Senthil Yogamani
Extension of these data augmentations for 3D object detection requires adaptation of the 3D geometry of the input scene and synthesis of new viewpoints.
no code implementations • 9 Apr 2021 • Varun Ravi Kumar, Marvin Klingner, Senthil Yogamani, Markus Bach, Stefan Milz, Tim Fingscheidt, Patrick Mäder
We evaluate our approach on the Fisheye WoodScape surround-view dataset, significantly improving over previous approaches.
no code implementations • 31 Mar 2021 • Ciaran Eising, Jonathan Horgan, Senthil Yogamani
In this work, we provide a detailed survey of such vision systems, setting up the survey in the context of an architecture that can be decomposed into four modular components namely Recognition, Reconstruction, Relocalization, and Reorganization.
no code implementations • 27 Feb 2021 • Anna Konrad, Ciarán Eising, Ganesh Sistu, John McDonald, Rudi Villing, Senthil Yogamani
Keypoint detection and description is a commonly used building block in computer vision systems particularly for robotics and autonomous driving.
1 code implementation • 15 Feb 2021 • Varun Ravi Kumar, Senthil Yogamani, Hazem Rashed, Ganesh Sistu, Christian Witt, Isabelle Leang, Stefan Milz, Patrick Mäder
We obtain the state-of-the-art results on KITTI for depth estimation and pose estimation tasks and competitive performance on the other tasks.
no code implementations • 3 Dec 2020 • Hazem Rashed, Eslam Mohamed, Ganesh Sistu, Varun Ravi Kumar, Ciaran Eising, Ahmad El-Sallab, Senthil Yogamani
It is the first detailed study on object detection on fisheye cameras for autonomous driving scenarios to the best of our knowledge.
1 code implementation • 16 Oct 2020 • Sumanth Chennupati, Venkatraman Narayanan, Ganesh Sistu, Senthil Yogamani, Samir A Rawashdeh
Instance contours along with semantic segmentation yield a boundary aware semantic segmentation of things.
no code implementations • 16 Aug 2020 • Eslam Mohamed, Mahmoud Ewaisha, Mennatullah Siam, Hazem Rashed, Senthil Yogamani, Waleed Hamdy, Muhammad Helmi, Ahmad El-Sallab
Moving object segmentation is a crucial task for autonomous vehicles as it can be used to segment objects in a class agnostic manner based on their motion cues.
no code implementations • 10 Aug 2020 • Varun Ravi Kumar, Marvin Klingner, Senthil Yogamani, Stefan Milz, Tim Fingscheidt, Patrick Maeder
This paper introduces a novel multi-task learning strategy to improve self-supervised monocular distance estimation on fisheye and pinhole camera images.
no code implementations • 19 Jul 2020 • Gabriel L. Oliveira, Senthil Yogamani, Wolfram Burgard, Thomas Brox
In order to further improve the architecture we introduce a weight function which aims to re-balance classes to increase the attention of the networks to under-represented objects.
no code implementations • 13 Jul 2020 • Varun Ravi Kumar, Senthil Yogamani, Markus Bach, Christian Witt, Stefan Milz, Patrick Mader
To further illustrate the general applicability of the proposed framework, we apply it to wide-angle fisheye cameras with 190$^\circ$ horizontal field of view.
no code implementations • 1 Jul 2020 • Arindam Das, Pavel Krizek, Ganesh Sistu, Fabian Burger, Sankaralingam Madasamy, Michal Uricar, Varun Ravi Kumar, Senthil Yogamani
Localized detection of soiling in an image is necessary to control the cleaning system.
no code implementations • 2 Feb 2020 • B Ravi Kiran, Ibrahim Sobh, Victor Talpaert, Patrick Mannion, Ahmad A. Al Sallab, Senthil Yogamani, Patrick Pérez
With the development of deep representation learning, the domain of reinforcement learning (RL) has become a powerful learning framework now capable of learning complex policies in high dimensional environments.
no code implementations • 7 Jan 2020 • Isabelle Leang, Ganesh Sistu, Fabian Burger, Andrei Bursuc, Senthil Yogamani
Deep multi-task networks are of particular interest for autonomous driving systems.
no code implementations • 7 Jan 2020 • Nivedita Tripathi, Senthil Yogamani
Existing parking systems build a local map to be able to plan for maneuvering towards a detected slot.
no code implementations • 23 Dec 2019 • Pullarao Maddu, Wayne Doherty, Ganesh Sistu, Isabelle Leang, Michal Uricar, Sumanth Chennupati, Hazem Rashed, Jonathan Horgan, Ciaran Hughes, Senthil Yogamani
We provide a holistic overview of an industrial system covering the embedded system, use cases and the deep learning architecture.
no code implementations • 4 Dec 2019 • Michal Uricar, Ganesh Sistu, Hazem Rashed, Antonin Vobecky, Varun Ravi Kumar, Pavel Krizek, Fabian Burger, Senthil Yogamani
We propose a novel GAN based algorithm for generating unseen patterns of soiled images.
no code implementations • 1 Dec 2019 • Mohamed Ramzy, Hazem Rashed, Ahmad El Sallab, Senthil Yogamani
The trajectory of the ego-vehicle is planned based on the future states of detected moving objects.
no code implementations • 11 Oct 2019 • Hazem Rashed, Mohamed Ramzy, Victor Vaquero, Ahmad El Sallab, Ganesh Sistu, Senthil Yogamani
In this work, we propose a robust and real-time CNN architecture for Moving Object Detection (MOD) under low-light conditions by capturing motion information from both camera and LiDAR sensors.
no code implementations • 7 Oct 2019 • Varun Ravi Kumar, Sandesh Athni Hiremath, Stefan Milz, Christian Witt, Clement Pinnard, Senthil Yogamani, Patrick Mader
Fisheye cameras are commonly used in applications like autonomous driving and surveillance to provide a large field of view ($>180^{\circ}$).
no code implementations • 30 Aug 2019 • Marie Yahiaoui, Hazem Rashed, Letizia Mariotti, Ganesh Sistu, Ian Clancy, Lucie Yahiaoui, Varun Ravi Kumar, Senthil Yogamani
In this work, we propose a CNN architecture for moving object detection using fisheye images that were captured in autonomous driving environment.
no code implementations • 1 Jun 2019 • Khaled El Madawy, Hazem Rashed, Ahmad El Sallab, Omar Nasr, Hanan Kamel, Senthil Yogamani
Motivated by the fact that semantic segmentation is a mature algorithm on image data, we explore sensor fusion based 3D segmentation.
no code implementations • 4 May 2019 • Michal Uricar, Pavel Krizek, Ganesh Sistu, Senthil Yogamani
Cameras are an essential part of sensor suite in autonomous driving.
1 code implementation • ICCV 2019 • Senthil Yogamani, Ciaran Hughes, Jonathan Horgan, Ganesh Sistu, Padraig Varley, Derek O'Dea, Michal Uricar, Stefan Milz, Martin Simon, Karl Amende, Christian Witt, Hazem Rashed, Sumanth Chennupati, Sanjaya Nayak, Saquib Mansoor, Xavier Perroton, Patrick Perez
Fisheye cameras are commonly employed for obtaining a large field of view in surveillance, augmented reality and in particular automotive applications.
no code implementations • 15 Apr 2019 • Sumanth Chennupati, Ganesh Sistu, Senthil Yogamani, Samir A Rawashdeh
In this work, we propose a multi-stream multi-task network to take advantage of using feature representations from preceding frames in a video sequence for joint learning of segmentation, depth, and motion.
no code implementations • 26 Feb 2019 • Maximilian Pöpperl, Raghavendra Gulagundi, Senthil Yogamani, Stefan Milz
High performance ultrasonic sensor hardware is mainly used in medical applications.
no code implementations • 26 Feb 2019 • Maximilian Pöpperl, Raghavendra Gulagundi, Senthil Yogamani, Stefan Milz
For the best of our knowledge, we present the first realistic data augmentation for automotive ultrasonics.
no code implementations • 10 Feb 2019 • Ganesh Sistu, Isabelle Leang, Sumanth Chennupati, Ciaran Hughes, Stefan Milz, Senthil Yogamani, Samir Rawashdeh
In this paper, we propose a joint multi-task network design for learning several tasks simultaneously.
no code implementations • 9 Feb 2019 • Michal Uricar, Pavel Krizek, David Hurych, Ibrahim Sobh, Senthil Yogamani, Patrick Denny
Generative Adversarial Networks (GAN) have gained a lot of popularity from their introduction in 2014 till present.
no code implementations • 26 Jan 2019 • Michal Uricar, David Hurych, Pavel Krizek, Senthil Yogamani
There is a large gap between academic and industrial setting and a substantial way from a research prototype, built on public datasets, to a deployable solution which is a challenging task.
no code implementations • 19 Jan 2019 • Arindam Das, Saranya Kandan, Senthil Yogamani, Pavel Krizek
Semantic segmentation remains a computationally intensive algorithm for embedded deployment even with the rapid growth of computation power.
no code implementations • 17 Jan 2019 • Sumanth Chennupati, Ganesh Sistu, Senthil Yogamani, Samir Rawashdeh
Decision making in automated driving is highly specific to the environment and thus semantic segmentation plays a key role in recognizing the objects in the environment around the car.
no code implementations • 12 Jan 2019 • Ganesh Sistu, Isabelle Leang, Senthil Yogamani
In this paper, we present a joint multi-task network design for learning object detection and semantic segmentation simultaneously.
no code implementations • 11 Jan 2019 • Sambit Mohapatra, Heinrich Gotzig, Senthil Yogamani, Stefan Milz, Raoul Zollner
Neural networks have become the standard model for various computer vision tasks in automated driving including semantic segmentation, moving object detection, depth estimation, visual odometry, etc.
no code implementations • 11 Jan 2019 • Hazem Rashed, Senthil Yogamani, Ahmad El-Sallab, Pavel Krizek, Mohamed El-Helw
We also make use of the ground truth optical flow in Virtual KITTI to serve as an ideal estimator and a standard Farneback optical flow algorithm to study the effect of noise.
no code implementations • 8 Jan 2019 • Ganesh Sistu, Sumanth Chennupati, Senthil Yogamani
We propose two simple high-level architectures based on Recurrent FCN (RFCN) and Multi-Stream FCN (MSFCN) networks.
no code implementations • 6 Jan 2019 • Victor Talpaert, Ibrahim Sobh, B Ravi Kiran, Patrick Mannion, Senthil Yogamani, Ahmad El-Sallab, Patrick Perez
Deep Reinforcement Learning (DRL) has become increasingly powerful in recent years, with notable achievements such as Deepmind's AlphaGo.
no code implementations • 28 Sep 2018 • B Ravi Kiran, Luis Roldão, Benat Irastorza, Renzo Verastegui, Sebastian Suss, Senthil Yogamani, Victor Talpaert, Alexandre Lepoutre, Guillaume Trehard
In this paper, we discuss real-time dynamic object detection algorithms which leverages previously mapped Lidar point clouds to reduce processing.
no code implementations • 16 Mar 2018 • Varun Ravi Kumar, Stefan Milz, Martin Simon, Christian Witt, Karl Amende, Johannes Petzold, Senthil Yogamani, Timo Pech
For instance, they do not capture the extensive variability in the appearance of objects like vehicles present in real datasets.
2 code implementations • 7 Mar 2018 • Mennatullah Siam, Mostafa Gamal, Moemen Abdel-Razek, Senthil Yogamani, Martin Jagersand
In this paper, we address this gap by presenting a real-time semantic segmentation benchmarking framework with a decoupled design for feature extraction and decoding methods.
no code implementations • 14 Sep 2017 • Mennatullah Siam, Heba Mahgoub, Mohamed Zahran, Senthil Yogamani, Martin Jagersand, Ahmad El-Sallab
Our experiments show that the proposed method outperforms state of the art methods that utilize motion cue only with 21. 5% in mAP on KITTI MOD.
no code implementations • 8 Jul 2017 • Mennatullah Siam, Sara Elkerdawy, Martin Jagersand, Senthil Yogamani
In this paper, the semantic segmentation problem is explored from the perspective of automated driving.
no code implementations • 25 May 2017 • B Ravi Kiran, Arindam Das, Senthil Yogamani
We achieve a good improvement in speed without compromising the accuracy with respect to the baseline GMM model.
1 code implementation • 8 Apr 2017 • Ahmad El Sallab, Mohammed Abdou, Etienne Perot, Senthil Yogamani
This is of particular relevance as it is difficult to pose autonomous driving as a supervised learning problem due to strong interactions with the environment including other vehicles, pedestrians and roadworks.
no code implementations • 13 Dec 2016 • Ahmad El Sallab, Mohammed Abdou, Etienne Perot, Senthil Yogamani
This is of particular interest as it is difficult to pose autonomous driving as a supervised learning problem as it has a strong interaction with the environment including other vehicles, pedestrians and roadworks.