Search Results for author:
Found 18 papers, 11 papers with code
Perturbed State Space Feature Encoders for Optical Flow with Event Cameras
With their motion-responsive nature, event-based cameras offer significant advantages over traditional cameras for optical flow estimation.
GEM: A Generalizable Ego-Vision Multimodal World Model for Fine-Grained Ego-Motion, Object Dynamics, and Scene Composition Control
We present GEM, a Generalizable Ego-vision Multimodal world model that predicts future frames using a reference frame, sparse features, human poses, and ego-trajectories.
FaVoR: Features via Voxel Rendering for Camera Relocalization
Camera relocalization methods range from dense image alignment to direct camera pose regression from a query image.
Few-shot point cloud reconstruction and denoising via learned Guassian splats renderings and fine-tuned diffusion features
Existing deep learning methods for the reconstruction and denoising of point clouds rely on small datasets of 3D shapes.
Mitigating Motion Blur in Neural Radiance Fields with Events and Frames
Neural Radiance Fields (NeRFs) have shown great potential in novel view synthesis.
Low-power event-based face detection with asynchronous neuromorphic hardware
We show that the power consumption of the chip is directly proportional to the number of synaptic operations in the spiking neural network, and we explore the trade-off between power consumption and detection precision with different firing rate regularization, achieving an on-chip face detection mAP[0. 5] of ~0. 6 while consuming only ~20 mW.
A 5-Point Minimal Solver for Event Camera Relative Motion Estimation
Event-based cameras are ideal for line-based motion estimation, since they predominantly respond to edges in the scene.
Deep Visual Odometry with Events and Frames
Visual Odometry (VO) is crucial for autonomous robotic navigation, especially in GPS-denied environments like planetary terrains.
Revisiting Token Pruning for Object Detection and Instance Segmentation
In relation to the dense counterpart that utilizes all tokens, our method realizes an increase in inference speed, achieving up to 34% faster performance for the entire network and 46% for the backbone.
E2(GO)MOTION: Motion Augmented Event Stream for Egocentric Action Recognition
However, the ever-growing field of event-based vision has, to date, overlooked the potential of event cameras in such applications.
E$^2$(GO)MOTION: Motion Augmented Event Stream for Egocentric Action Recognition
However, the ever-growing field of event-based vision has, to date, overlooked the potential of event cameras in such applications.
Neural Weighted A*: Learning Graph Costs and Heuristics with Differentiable Anytime A*
Recently, the trend of incorporating differentiable algorithms into deep learning architectures arose in machine learning research, as the fusion of neural layers and algorithmic layers has been beneficial for handling combinatorial data, such as shortest paths on graphs.
DA4Event: towards bridging the Sim-to-Real Gap for Event Cameras using Domain Adaptation
Event cameras are novel bio-inspired sensors, which asynchronously capture pixel-level intensity changes in the form of "events".
Spatial Temporal Transformer Network for Skeleton-based Action Recognition
Skeleton-based human action recognition has achieved a great interest in recent years, as skeleton data has been demonstrated to be robust to illumination changes, body scales, dynamic camera views, and complex background.
Skeleton-based Action Recognition via Spatial and Temporal Transformer Networks
Skeleton-based Human Activity Recognition has achieved great interest in recent years as skeleton data has demonstrated being robust to illumination changes, body scales, dynamic camera views, and complex background.
A Differentiable Recurrent Surface for Asynchronous Event-Based Data
Dynamic Vision Sensors (DVSs) asynchronously stream events in correspondence of pixels subject to brightness changes.
Attention Mechanisms for Object Recognition with Event-Based Cameras
Event-based cameras are neuromorphic sensors capable of efficiently encoding visual information in the form of sparse sequences of events.
Asynchronous Convolutional Networks for Object Detection in Neuromorphic Cameras
Event-based cameras, also known as neuromorphic cameras, are bioinspired sensors able to perceive changes in the scene at high frequency with low power consumption.
