Search Results for author:
Found 9 papers, 8 papers with code
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models
We try to narrow the gap by mining the potential of VLMs for better performance and any-to-any workflow from three aspects, i. e., high-resolution visual tokens, high-quality data, and VLM-guided generation.
Ranked #8 on
Visual Question Answering
on MM-Vet
Prompt Highlighter: Interactive Control for Multi-Modal LLMs
Without tuning on LLaVA-v1. 5, our method secured 70. 7 in the MMBench test and 1552. 5 in MME-perception.
Make-Your-Video: Customized Video Generation Using Textual and Structural Guidance
Our method, dubbed Make-Your-Video, involves joint-conditional video generation using a Latent Diffusion Model that is pre-trained for still image synthesis and then promoted for video generation with the introduction of temporal modules.
Real-World Image Variation by Aligning Diffusion Inversion Chain
Our pipeline enhances the generation quality of image variations by aligning the image generation process to the source image's inversion chain.
Video-P2P: Video Editing with Cross-attention Control
This paper presents Video-P2P, a novel framework for real-world video editing with cross-attention control.
CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior
In this paper, we propose to cast speech-driven facial animation as a code query task in a finite proxy space of the learned codebook, which effectively promotes the vividness of the generated motions by reducing the cross-modal mapping uncertainty.
Ranked #4 on
3D Face Animation
on BEAT2
Ref-NPR: Reference-Based Non-Photorealistic Radiance Fields for Controllable Scene Stylization
We propose a ray registration process based on the stylized reference view to obtain pseudo-ray supervision in novel views.
PCL: Proxy-Based Contrastive Learning for Domain Generalization
Domain generalization refers to the problem of training a model from a collection of different source domains that can directly generalize to the unseen target domains.
Ranked #17 on
Domain Generalization
on PACS
High Quality Segmentation for Ultra High-resolution Images
To segment 4K or 6K ultra high-resolution images needs extra computation consideration in image segmentation.
