Image Animation
45 papers with code • 0 benchmarks • 0 datasets
Image Animation is a field for image-animation of a source image by a driving video
Benchmarks
These leaderboards are used to track progress in Image Animation
Most implemented papers
AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning
Once trained, the motion module can be inserted into a personalized T2I model to form a personalized animation generator.
First Order Motion Model for Image Animation
To achieve this, we decouple appearance and motion information using a self-supervised formulation.
MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model
Existing animation works typically employ the frame-warping technique to animate the reference image towards the target motion.
Image Animation with Perturbed Masks
We present a novel approach for image-animation of a source image by a driving video, both depicting the same type of object.
SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation
We present SadTalker, which generates 3D motion coefficients (head pose, expression) of the 3DMM from audio and implicitly modulates a novel 3D-aware face render for talking head generation.
DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors
Animating a still image offers an engaging visual experience.
Moonshot: Towards Controllable Video Generation and Editing with Multimodal Conditions
This work presents Moonshot, a new video generation model that conditions simultaneously on multimodal inputs of image and text.
UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation
First, to reduce the optimization difficulty and ensure temporal coherence, we map the reference image along with the posture guidance and noise video into a common feature space by incorporating a unified video diffusion model.
Animating Arbitrary Objects via Deep Motion Transfer
This is achieved through a deep architecture that decouples appearance and motion information.
Creative Flow+ Dataset
We present the Creative Flow+ Dataset, the first diverse multi-style artistic video dataset richly labeled with per-pixel optical flow, occlusions, correspondences, segmentation labels, normals, and depth.