no code implementations • 1 Apr 2024 • Ling Gao, Daniel Gehrig, Hang Su, Davide Scaramuzza, Laurent Kneip
To recover the full linear camera velocity we fuse observations from multiple lines with a novel velocity averaging scheme that relies on a geometrically-motivated residual, and thus solves the problem more efficiently than previous schemes which minimize an algebraic residual.
no code implementations • ICCV 2023 • Ling Gao, Hang Su, Daniel Gehrig, Marco Cannici, Davide Scaramuzza, Laurent Kneip
Event-based cameras are ideal for line-based motion estimation, since they predominantly respond to edges in the scene.
no code implementations • 18 Sep 2023 • Roberto Pellerito, Marco Cannici, Daniel Gehrig, Joris Belhadj, Olivier Dubois-Matra, Massimo Casasco, Davide Scaramuzza
Visual Odometry (VO) is crucial for autonomous robotic navigation, especially in GPS-denied environments like planetary terrains.
1 code implementation • 15 Jun 2023 • Mohammed Salah, Abdulla Ayyad, Muhammad Humais, Daniel Gehrig, Abdelqader Abusafieh, Lakmal Seneviratne, Davide Scaramuzza, Yahya Zweiri
However, conventional image-based calibration techniques are not applicable due to the asynchronous, binary output of the sensor.
1 code implementation • ICCV 2023 • Nikola Zubić, Daniel Gehrig, Mathias Gehrig, Davide Scaramuzza
However, selecting the appropriate representation for the task traditionally requires training a neural network for each representation and selecting the best one based on the validation score, which is very time-consuming.
Ranked #1 on Object Detection on GEN1 Detection
no code implementations • 24 Mar 2023 • Asude Aydin, Mathias Gehrig, Daniel Gehrig, Davide Scaramuzza
Our hybrid ANN-SNN model thus combines the best of both worlds: It does not suffer from long state transients and state decay thanks to the ANN, and can generate predictions with high temporal resolution, low latency, and low power thanks to the SNN.
no code implementations • 22 Nov 2022 • Daniel Gehrig, Davide Scaramuzza
A recent line of work tackles this issue by modeling events as spatiotemporally evolving graphs that can be efficiently and asynchronously processed using graph neural networks.
no code implementations • 12 Apr 2022 • Florian Mahlknecht, Daniel Gehrig, Jeremy Nash, Friedrich M. Rockenbauer, Benjamin Morrell, Jeff Delaune, Davide Scaramuzza
Due to their resilience to motion blur and high robustness in low-light and high dynamic range conditions, event cameras are poised to become enabling sensors for vision-based exploration on future Mars helicopter missions.
no code implementations • CVPR 2022 • Stepan Tulyakov, Alfredo Bochicchio, Daniel Gehrig, Stamatios Georgoulis, Yuanyou Li, Davide Scaramuzza
Recently, video frame interpolation using a combination of frame- and event-based cameras has surpassed traditional image-based methods both in terms of performance and memory efficiency.
no code implementations • CVPR 2022 • Simon Schaefer, Daniel Gehrig, Davide Scaramuzza
For this reason, recent works have adopted Graph Neural Networks (GNNs), which process events as ``static" spatio-temporal graphs, which are inherently "sparse".
no code implementations • 28 Mar 2022 • Daniel Gehrig, Davide Scaramuzza
We provide both empirical and theoretical evidence for this claim, which indicates that high-resolution event cameras exhibit higher per-pixel event rates, leading to higher temporal noise in low-illumination conditions and at high speeds.
1 code implementation • 18 Mar 2022 • Zhaoning Sun, Nico Messikommer, Daniel Gehrig, Davide Scaramuzza
Nonetheless, semantic segmentation with event cameras is still in its infancy which is chiefly due to the lack of high-quality, labeled datasets.
Ranked #5 on Event-based Object Segmentation on MVSEC-SEG
no code implementations • 13 Mar 2022 • Nico Messikommer, Stamatios Georgoulis, Daniel Gehrig, Stepan Tulyakov, Julius Erbach, Alfredo Bochicchio, Yuanyou Li, Davide Scaramuzza
Modern high dynamic range (HDR) imaging pipelines align and fuse multiple low dynamic range (LDR) images captured at different exposure times.
1 code implementation • 6 Sep 2021 • Nico Messikommer, Daniel Gehrig, Mathias Gehrig, Davide Scaramuzza
However, event-based vision has been held back by the shortage of labeled datasets due to the novelty of event cameras.
1 code implementation • 24 Aug 2021 • Mathias Gehrig, Mario Millhäusler, Daniel Gehrig, Davide Scaramuzza
Modern frame-based optical flow methods heavily rely on matching costs computed from feature correlation.
1 code implementation • CVPR 2021 • Stepan Tulyakov, Daniel Gehrig, Stamatios Georgoulis, Julius Erbach, Mathias Gehrig, Yuanyou Li, Davide Scaramuzza
However, while these approaches can capture non-linear motions they suffer from ghosting and perform poorly in low-texture regions with few events.
1 code implementation • 14 Jun 2021 • Stepan Tulyakov, Daniel Gehrig, Stamatios Georgoulis, Julius Erbach, Mathias Gehrig, Yuanyou Li, Davide Scaramuzza
State-of-the-art frame interpolation methods generate intermediate frames by inferring object motions in the image from consecutive key-frames.
1 code implementation • 26 May 2021 • Manasi Muglikar, Mathias Gehrig, Daniel Gehrig, Davide Scaramuzza
We propose a generic event camera calibration framework using image reconstruction.
1 code implementation • 10 Mar 2021 • Mathias Gehrig, Willem Aarents, Daniel Gehrig, Davide Scaramuzza
To address these challenges, we propose, DSEC, a new dataset that contains such demanding illumination conditions and provides a rich set of sensory data.
1 code implementation • 18 Feb 2021 • Daniel Gehrig, Michelle Rüegg, Mathias Gehrig, Javier Hidalgo Carrio, Davide Scaramuzza
However, events only measure the varying component of the visual signal, which limits their ability to encode scene context.
1 code implementation • 16 Oct 2020 • Javier Hidalgo-Carrió, Daniel Gehrig, Davide Scaramuzza
Event cameras are novel sensors that output brightness changes in the form of a stream of asynchronous events instead of intensity frames.
1 code implementation • ECCV 2020 • Nico Messikommer, Daniel Gehrig, Antonio Loquercio, Davide Scaramuzza
However, these approaches discard the spatial and temporal sparsity inherent in event data at the cost of higher computational complexity and latency.
1 code implementation • CVPR 2020 • Daniel Gehrig, Mathias Gehrig, Javier Hidalgo-Carrió, Davide Scaramuzza
Event cameras are novel sensors that output brightness changes in the form of a stream of asynchronous "events" instead of intensity frames.
1 code implementation • ICCV 2019 • Daniel Gehrig, Antonio Loquercio, Konstantinos G. Derpanis, Davide Scaramuzza
Event cameras are vision sensors that record asynchronous streams of per-pixel brightness changes, referred to as "events".
Ranked #15 on Robust classification on N-ImageNet
1 code implementation • ECCV 2018 • Daniel Gehrig, Henri Rebecq, Guillermo Gallego, Davide Scaramuzza
By contrast, standard cameras provide intensity measurements (frames) that do not depend on motion direction.