Search Results for author:
Found 12 papers, 9 papers with code
StyleCrafter: Enhancing Stylized Text-to-Video Generation with Style Adapter
To address these challenges, we introduce StyleCrafter, a generic method that enhances pre-trained T2V models with a style control adapter, enabling video generation in any style by providing a reference image.
VideoCrafter1: Open Diffusion Models for High-Quality Video Generation
The I2V model is designed to produce videos that strictly adhere to the content of the provided reference image, preserving its content, structure, and style.
Ranked #3 on
Text-to-Video Generation
on EvalCrafter Text-to-Video (ECTV) Dataset
(using extra training data)
DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors
Animating a still image offers an engaging visual experience.
Animate-A-Story: Storytelling with Retrieval-Augmented Video Generation
For the first module, we leverage an off-the-shelf video retrieval system and extract video depths as motion structure.
Video Colorization with Pre-trained Text-to-Image Diffusion Models
In this paper, we present ColorDiffuser, an adaptation of a pre-trained text-to-image latent diffusion model for video colorization.
Make-Your-Video: Customized Video Generation Using Textual and Structural Guidance
Our method, dubbed Make-Your-Video, involves joint-conditional video generation using a Latent Diffusion Model that is pre-trained for still image synthesis and then promoted for video generation with the introduction of temporal modules.
Real-World Image Variation by Aligning Diffusion Inversion Chain
Our pipeline enhances the generation quality of image variations by aligning the image generation process to the source image's inversion chain.
Improved Diffusion-based Image Colorization via Piggybacked Models
Our key idea is to exploit the color prior knowledge in the pre-trained T2I diffusion model for realistic and diverse colorization.
CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior
In this paper, we propose to cast speech-driven facial animation as a code query task in a finite proxy space of the learned codebook, which effectively promotes the vividness of the generated motions by reducing the cross-modal mapping uncertainty.
Ranked #4 on
3D Face Animation
on BEAT2
Ref-NPR: Reference-Based Non-Photorealistic Radiance Fields for Controllable Scene Stylization
We propose a ray registration process based on the stylized reference view to obtain pseudo-ray supervision in novel views.
Scale-arbitrary Invertible Image Downscaling
In this paper, we propose a scale-Arbitrary Invertible image Downscaling Network (AIDN), to natively downscale HR images with arbitrary scale factors.
Unstructured Knowledge Access in Task-oriented Dialog Modeling using Language Inference, Knowledge Retrieval and Knowledge-Integrative Response Generation
Dialog systems enriched with external knowledge can handle user queries that are outside the scope of the supporting databases/APIs.
