Event-based vision

43 papers with code • 1 benchmarks • 9 datasets

An event camera, also known as a neuromorphic camera, silicon retina or dynamic vision sensor, is an imaging sensor that responds to local changes in brightness. Event cameras do not capture images using a shutter as conventional cameras do. Instead, each pixel inside an event camera operates independently and asynchronously, reporting changes in brightness as they occur and staying silent otherwise. Modern event cameras have microsecond temporal resolution, 120 dB dynamic range, and less under/overexposure and motion blur than frame cameras.

Libraries

Use these libraries to find Event-based vision models and implementations

Most implemented papers

Bridging the Gap between Events and Frames through Unsupervised Domain Adaptation

uzh-rpg/rpg_ev-transfer 6 Sep 2021

However, event-based vision has been held back by the shortage of labeled datasets due to the novelty of event cameras.

Moving Object Detection for Event-based vision using Graph Spectral Clustering

anindya2001/GSCEventMOD International Conference on Computer Vision Workshops 2021

However, these advantages come at a high cost, as the event camera data typically contains more noise and has low resolution.

Adversarial Attacks on Spiking Convolutional Neural Networks for Event-based Vision

jubueche/spaa 6 Oct 2021

Event-based dynamic vision sensors provide very sparse output in the form of spikes, which makes them suitable for low-power applications.

Optical Flow Estimation for Spiking Camera

acnext/optical-flow-for-spiking-camera CVPR 2022

Further, for training SCFlow, we synthesize two sets of optical flow data for the spiking camera, SPIkingly Flying Things and Photo-realistic High-speed Motion, denoted as SPIFT and PHM respectively, corresponding to random high-speed and well-designed scenes.

E$^2$(GO)MOTION: Motion Augmented Event Stream for Egocentric Action Recognition

egocentricvision/n-epic-kitchens 7 Dec 2021

However, the ever-growing field of event-based vision has, to date, overlooked the potential of event cameras in such applications.

E2(GO)MOTION: Motion Augmented Event Stream for Egocentric Action Recognition

egocentricvision/n-epic-kitchens CVPR 2022

However, the ever-growing field of event-based vision has, to date, overlooked the potential of event cameras in such applications.

Ev-TTA: Test-Time Adaptation for Event-Based Object Recognition

82magnolia/ev_tta CVPR 2022

We introduce Ev-TTA, a simple, effective test-time adaptation algorithm for event-based object recognition.

Fusing Event-based and RGB camera for Robust Object Detection in Adverse Conditions

abhishek1411/event-rgb-fusion ICRA 2022

The ability to detect objects, under image corruptions and different weather conditions is vital for deep learning models especially when applied to real-world applications such as autonomous driving.

Event Collapse in Contrast Maximization Frameworks

tub-rip/event_based_optical_flow 8 Jul 2022

Contrast maximization (CMax) is a framework that provides state-of-the-art results on several event-based computer vision tasks, such as ego-motion or optical flow estimation.