Search Results for author:
Found 28 papers, 16 papers with code
GaussianIP: Identity-Preserving Realistic 3D Human Generation via Human-Centric Diffusion Prior
In stage 1, we propose a novel Adaptive Human Distillation Sampling (AHDS) method to rapidly generate a 3D human that maintains high identity consistency with the image prompt and achieves a realistic appearance.
Towards Fine-grained Interactive Segmentation in Images and Videos
Existing methods for high-precision interactive segmentation face a trade-off between the ability to perceive intricate local details and maintaining stable prompting capability, which hinders the applicability and effectiveness of foundational segmentation models.
Perception-as-Control: Fine-grained Controllable Image Animation with 3D-aware Motion Representation
Recent works have made progress in controlling camera or object motion via various motion representations, while they still struggle to support collaborative camera and object motion control with adaptive control granularity.
MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modeling
To this end, we propose MIMO, a novel framework which can not only synthesize character videos with controllable attributes (i. e., character, motion and scene) provided by simple user inputs, but also simultaneously achieve advanced scalability to arbitrary characters, generality to novel 3D motions, and applicability to interactive real-world scenes in a unified framework.
MotionCom: Automatic and Motion-Aware Image Composition with LLM and Video Diffusion Prior
This work presents MotionCom, a training-free motion-aware diffusion based image composition, enabling automatic and seamless integration of target objects into new scenes with dynamically coherent results without finetuning or optimization.
I4VGen: Image as Free Stepping Stone for Text-to-Video Generation
Text-to-video generation has trailed behind text-to-image generation in terms of quality and diversity, primarily due to the inherent complexities of spatio-temporal modeling and the limited availability of video-text datasets.
Disentangling Foreground and Background Motion for Enhanced Realism in Human Video Generation
Training on real-world videos enhanced with this innovative motion depiction approach, our model generates videos exhibiting coherent movement in both foreground subjects and their surrounding contexts.
InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimization
Recent strides in the development of diffusion models, exemplified by advancements such as Stable Diffusion, have underscored their remarkable prowess in generating visually compelling images.
DivAvatar: Diverse 3D Avatar Generation with a Single Prompt
We design DivAvatar, a novel framework that generates diverse avatars, empowering 3D creatives with a multitude of distinct and richly varied 3D avatars from a single text prompt.
En3D: An Enhanced Generative Model for Sculpting 3D Humans from 2D Synthetic Data
We present En3D, an enhanced generative scheme for sculpting high-quality 3D human avatars.
3DToonify: Creating Your High-Fidelity 3D Stylized Avatar Easily from 2D Portrait Images
In this paper we make a connection between the two and tackle the challenging task of 3D portrait stylization - modeling high-fidelity 3D stylized avatars from captured 2D portrait images.
DiffusionGAN3D: Boosting Text-guided 3D Generation and Domain Adaptation by Combining 3D GANs and Diffusion Priors
Extensive experiments demonstrate that the proposed framework achieves excellent results in both domain adaptation and text-to-avatar tasks, outperforming existing methods in terms of generation quality and efficiency.
DreaMoving: A Human Video Generation Framework based on Diffusion Models
In this paper, we present DreaMoving, a diffusion-based controllable video generation framework to produce high-quality customized human videos.
Boosting3D: High-Fidelity Image-to-3D by Boosting 2D Diffusion Prior to 3D Prior with Progressive Learning
After the progressive training, the LoRA learns the 3D information of the generated object and eventually turns to an object-level 3D prior.
Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Models
This is a technical report on the 360-degree panoramic image generation task based on diffusion models.
A Hierarchical Representation Network for Accurate and Detailed Face Reconstruction from In-The-Wild Images
Meanwhile, 3D priors of facial details are incorporated to enhance the accuracy and authenticity of the reconstruction results.
Ranked #4 on
3D Face Reconstruction
on REALY (side-view)
Box2Mask: Box-supervised Instance Segmentation via Level-set Evolution
In contrast to fully supervised methods using pixel-wise mask labels, box-supervised instance segmentation takes advantage of simple box annotations, which has recently attracted increasing research attention.
Box-supervised Instance Segmentation with Level Set Evolution
A simple mask supervised SOLOv2 model is adapted to predict the instance-aware mask map as the level set for each instance.
DCT-Net: Domain-Calibrated Translation for Portrait Stylization
This paper introduces DCT-Net, a novel image translation architecture for few-shot portrait stylization.
Towards Counterfactual Image Manipulation via CLIP
In addition, we design a simple yet effective scheme that explicitly maps CLIP embeddings (of target text) to the latent space and fuses them with latent codes for effective latent code optimization and accurate editing.
Improving Nighttime Driving-Scene Segmentation via Dual Image-adaptive Learnable Filters
With DIAL-Filters, we design both unsupervised and supervised frameworks for nighttime driving-scene segmentation, which can be trained in an end-to-end manner.
Structure-Aware Flow Generation for Human Body Reshaping
Body reshaping is an important procedure in portrait photo retouching.
ABPN: Adaptive Blend Pyramid Network for Real-Time Local Retouching of Ultra High-Resolution Photo
The network is mainly composed of two components: a context-aware local retouching layer (LRL) and an adaptive blend pyramid layer (BPL).
Unpaired Cartoon Image Synthesis via Gated Cycle Mapping
Experimental results demonstrate the superiority of the proposed method over the state of the art and validate its effectiveness in the brand-new task of general cartoon image synthesis.
Attention-guided Temporally Coherent Video Object Matting
Experimental results show that our method can generate high-quality alpha mattes for various videos featuring appearance change, occlusion, and fast motion.
PPR10K: A Large-Scale Portrait Photo Retouching Dataset with Human-Region Mask and Group-Level Consistency
HRP requires that more attention should be paid to human regions, while GLC requires that a group of portrait photos should be retouched to a consistent tone.
Active Boundary Loss for Semantic Segmentation
This paper proposes a novel active boundary loss for semantic segmentation.
Boosting Semantic Human Matting with Coarse Annotations
In this paper, we propose to use coarse annotated data coupled with fine annotated data to boost end-to-end semantic human matting without trimaps as extra input.
Ranked #9 on
Image Matting
on AM-2K
