Search Results for author:
Found 11 papers, 6 papers with code
Joint Co-Speech Gesture and Expressive Talking Face Generation using Diffusion with Adapters
Recent advances in co-speech gesture and talking head generation have been impressive, yet most methods focus on only one of the two tasks.
DiffTED: One-shot Audio-driven TED Talk Video Generation with Diffusion-based Co-speech Gestures
Audio-driven talking video generation has advanced significantly, but existing methods often depend on video-to-video translation techniques and traditional generative networks like GANs and they typically generate taking heads and co-speech gestures separately, leading to less coherent outputs.
Urban Waterlogging Detection: A Challenging Benchmark and Large-Small Model Co-Adapter
Urban waterlogging poses a major risk to public safety and infrastructure.
Vision Mamba: A Comprehensive Survey and Taxonomy
In the field of deep learning, state space models are used to process sequence data, such as time series analysis, natural language processing (NLP) and video understanding.
Magic-Boost: Boost 3D Generation with Multi-View Conditioned Diffusion
In detail, we first propose a novel multi-view conditioned diffusion model which extracts 3d prior from the synthesized multi-view images to synthesize high-fidelity novel view images and then introduce a novel iterative-update strategy to adopt it to provide precise guidance to refine the coarse generated results through a fast optimization process.
Robust Active Speaker Detection in Noisy Environments
Experiments demonstrate that non-speech audio noises significantly impact ASD models, and our proposed approach improves ASD performance in noisy environments.
Sora Generates Videos with Stunning Geometrical Consistency
We employ a method that transforms the generated videos into 3D models, leveraging the premise that the accuracy of 3D reconstruction is heavily contingent on the video quality.
DREAM-Talk: Diffusion-based Realistic Emotional Audio-driven Method for Single Image Talking Face Generation
The generation of emotional talking faces from a single portrait image remains a significant challenge.
AvatarStudio: High-fidelity and Animatable 3D Avatar Creation from Text
We study the problem of creating high-fidelity and animatable 3D avatars from only textual descriptions.
MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model
Existing animation works typically employ the frame-warping technique to animate the reference image towards the target motion.
FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning
In this paper, we propose a talking face generation method that takes an audio signal as input and a short target video clip as reference, and synthesizes a photo-realistic video of the target face with natural lip motions, head poses, and eye blinks that are in-sync with the input audio signal.
