Search Results for author:
Found 11 papers, 3 papers with code
UniMuMo: Unified Text, Music and Motion Generation
We introduce a music-motion parallel generation scheme that unifies all music and motion generation tasks into a single transformer decoder architecture with a single training task of music-motion joint generation.
RapVerse: Coherent Vocals and Whole-Body Motions Generations from Text
In this work, we introduce a challenging task for simultaneously generating 3D holistic body motions and singing vocals directly from textual lyrics inputs, advancing beyond existing works that typically address these two modalities in isolation.
SportsSloMo: A New Benchmark and Baselines for Human-centric Video Frame Interpolation
We re-train several state-of-the-art methods on our benchmark, and the results show a decrease in their accuracy compared to other datasets.
Revisiting Event-based Video Frame Interpolation
We therefore propose to incorporate RGB information in an event-guided optical flow refinement strategy.
Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstruction
Novel view synthesis via Neural Radiance Fields (NeRFs) or 3D Gaussian Splatting (3DGS) typically necessitates dense observations with hundreds of input images to circumvent artifacts.
iQuery: Instruments as Queries for Audio-Visual Sound Separation
To generalize to a new instrument or event class, drawing inspiration from the text-prompt design, we insert an additional query as an audio prompt while freezing the attention mechanism.
Unsupervised Multi-View Object Segmentation Using Radiance Field Propagation
The core of our method is a novel propagation strategy for individual objects' radiance fields with a bidirectional photometric loss, enabling an unsupervised partitioning of a scene into salient or meaningful regions corresponding to different object instances.
VECtor: A Versatile Event-Centric Benchmark for Multi-Sensor SLAM
Event cameras have recently gained in popularity as they hold strong potential to complement regular cameras in situations of high dynamics or challenging illumination.
DEVO: Depth-Event Camera Visual Odometry in Challenging Conditions
We present a novel real-time visual odometry framework for a stereo setup of a depth and high-resolution event camera.
AutoVideo: An Automated Video Action Recognition System
Action recognition is an important task for video understanding with broad applications.
Visual Odometry with an Event Camera Using Continuous Ray Warping and Volumetric Contrast Maximization
We present a new solution to tracking and mapping with an event camera.
