Search Results for author:
Found 12 papers, 4 papers with code
USP-Gaussian: Unifying Spike-based Image Reconstruction, Pose Correction and Gaussian Splatting
Leveraging the multi-view consistency afforded by 3DGS and the motion capture capability of the spike camera, our framework enables a joint iterative optimization that seamlessly integrates information between the spike-to-image network and 3DGS.
SpikeGS: 3D Gaussian Splatting from Spike Streams with High-Speed Camera Motion
To address this issue, we make the first attempt to introduce the 3D Gaussian Splatting (3DGS) into spike cameras in high-speed capture, providing 3DGS as dense and continuous clues of views, then constructing SpikeGS.
SpikeMM: Flexi-Magnification of High-Speed Micro-Motions
This innovative approach comprehensively records temporal and spatial visual information, rendering it particularly suitable for magnifying high-speed micro-motions. This paper introduces SpikeMM, a pioneering spike-based algorithm tailored specifically for high-speed motion magnification.
SpikeReveal: Unlocking Temporal Sequences from Real Blurry Inputs with Spike Streams
Our approach begins with the formulation of a spike-guided deblurring model that explores the theoretical relationships among spike streams, blurry images, and their corresponding sharp sequences.
Spike-guided Motion Deblurring with Unknown Modal Spatiotemporal Alignment
It can supplement the temporal information lost in traditional cameras and guide motion deblurring.
Unveiling the Potential of Spike Streams for Foreground Occlusion Removal from Densely Continuous Views
To process the spikes, we build a novel model \textbf{SpkOccNet}, in which we integrate information of spikes from continuous viewpoints within multi-windows, and propose a novel cross-view mutual attention mechanism for effective fusion and refinement.
SpikeCV: Open a Continuous Computer Vision Era
SpikeCV focuses on encapsulation for spike data, standardization for dataset interfaces, modularization for vision tasks, and real-time applications for challenging scenes.
1000x Faster Camera and Machine Vision with Ordinary Devices
By treating vidar as spike trains in biological vision, we have further developed a spiking neural network-based machine vision system that combines the speed of the machine and the mechanism of biological vision, achieving high-speed object detection and tracking 1, 000x faster than human vision.
High-Speed Image Reconstruction Through Short-Term Plasticity for Spiking Cameras
Mimicking the sampling mechanism of the fovea, a retina-inspired camera, named spiking camera, is developed to record the external information with a sampling rate of 40, 000 Hz, and outputs asynchronous binary spike streams.
Reconstruction of Natural Visual Scenes from Neural Spikes with Deep Neural Networks
The SID is an end-to-end decoder with one end as neural spikes and the other end as images, which can be trained directly such that visual scenes are reconstructed from spikes in a highly accurate fashion.
Probabilistic Inference of Binary Markov Random Fields in Spiking Neural Networks through Mean-field Approximation
Recent studies have suggested that the cognitive process of the human brain is realized as probabilistic inference and can be further modeled by probabilistic graphical models like Markov random fields.
Revealing Fine Structures of the Retinal Receptive Field by Deep Learning Networks
When a deep CNN with many layers is used for the visual system, it is not easy to compare the structure components of CNNs with possible neuroscience underpinnings due to highly complex circuits from the retina to higher visual cortex.
