Search Results for author:
Found 7 papers, 4 papers with code
EchoReel: Enhancing Action Generation of Existing Video Diffusion Models
Recent large-scale video datasets have facilitated the generation of diverse open-domain videos of Video Diffusion Models (VDMs).
CoIN: A Benchmark of Continual Instruction tuNing for Multimodel Large Language Model
To this end, we introduce MoELoRA to MLLMs which is effective to retain the previous instruction alignment.
Training-Free Semantic Video Composition via Pre-trained Diffusion Model
Therefore, we propose a training-free pipeline employing a pre-trained diffusion model imbued with semantic prior knowledge, which can process composite videos with broader semantic disparities.
CUCL: Codebook for Unsupervised Continual Learning
To address this issue, after analyzing the phenomenon and identifying the lack of diversity as a vital factor, we propose a method named Codebook for Unsupervised Continual Learning (CUCL) which promotes the model to learn discriminative features to complete the class boundary.
MobileVidFactory: Automatic Diffusion-Based Social Media Video Generation for Mobile Devices from Text
In the basic generation, we take advantage of the pretrained image diffusion model, and adapt it to a high-quality open-domain vertical video generator for mobile devices.
MovieFactory: Automatic Movie Creation from Text using Large Generative Models for Language and Images
To generate videos, we extend the capabilities of a pretrained text-to-image diffusion model through a two-stage process.
Swap Attention in Spatiotemporal Diffusions for Text-to-Video Generation
Moreover, to fully unlock model capabilities for high-quality video generation and promote the development of the field, we curate a large-scale and open-source video dataset called HD-VG-130M.
Ranked #1 on
Text-to-Video Generation
on WebVid
