Search Results for author:
Found 22 papers, 8 papers with code
EraseAnything: Enabling Concept Erasure in Rectified Flow Transformers
Removing unwanted concepts from large-scale text-to-image (T2I) diffusion models while maintaining their overall generative quality remains an open challenge.
OutfitAnyone: Ultra-high Quality Virtual Try-On for Any Clothing and Any Person
Specifically, these models struggle to maintain a balance between control and consistency when generating images for virtual clothing trials.
EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditions
In this work, we tackle the challenge of enhancing the realism and expressiveness in talking head video generation by focusing on the dynamic and nuanced relationship between audio cues and facial movements.
MaTe3D: Mask-guided Text-based 3D-aware Portrait Editing
This enhances masked-based editing in local areas; second, we present a novel distillation strategy: Conditional Distillation on Geometry and Texture (CDGT).
VividTalk: One-Shot Audio-Driven Talking Head Generation Based on 3D Hybrid Prior
Audio-driven talking head generation has drawn much attention in recent years, and many efforts have been made in lip-sync, expressive facial expressions, natural head pose generation, and high video quality.
Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation
Character Animation aims to generating character videos from still images through driving signals.
RenderIH: A Large-scale Synthetic Dataset for 3D Interacting Hand Pose Estimation
The current interacting hand (IH) datasets are relatively simplistic in terms of background and texture, with hand joints being annotated by a machine annotator, which may result in inaccuracies, and the diversity of pose distribution is limited.
Cloth2Tex: A Customized Cloth Texture Generation Pipeline for 3D Virtual Try-On
Since traditional warping-based texture generation methods require a significant number of control points to be manually selected for each type of garment, which can be a time-consuming and tedious process.
DiffHand: End-to-End Hand Mesh Reconstruction via Diffusion Models
Hand mesh reconstruction from the monocular image is a challenging task due to its depth ambiguity and severe occlusion, there remains a non-unique mapping between the monocular image and hand mesh.
Gloss-Free End-to-End Sign Language Translation
In this paper, we tackle the problem of sign language translation (SLT) without gloss annotations.
One-Shot High-Fidelity Talking-Head Synthesis with Deformable Neural Radiance Field
Talking head generation aims to generate faces that maintain the identity information of the source image and imitate the motion of the driving image.
Towards Stable Human Pose Estimation via Cross-View Fusion and Foot Stabilization
Then the optimization-based method is introduced to reconstruct the foot pose and foot-ground contact for the general multi-view datasets including AIST++ and Human3. 6M.
DART: Articulated Hand Model with Diverse Accessories and Rich Textures
Unity GUI is also provided to generate synthetic hand data with user-defined settings, e. g., pose, camera, background, lighting, textures, and accessories.
Jointly Harnessing Prior Structures and Temporal Consistency for Sign Language Video Generation
We optimize the two losses and keypoint detector network in an end-to-end manner.
One-stage Action Detection Transformer
In this work, we introduce our solution to the EPIC-KITCHENS-100 2022 Action Detection challenge.
Recurrent Dynamic Embedding for Video Object Segmentation
In this paper, we propose a Recurrent Dynamic Embedding (RDE) to build a memory bank of constant size.
Ranked #16 on
Semi-Supervised Video Object Segmentation
on MOSE
Multi-View Consistent Generative Adversarial Networks for 3D-aware Image Synthesis
To address this challenge, we propose Multi-View Consistent Generative Adversarial Networks (MVCGAN) for high-quality 3D-aware image synthesis with geometry constraints.
Divide and Rule: Recurrent Partitioned Network for Dynamic Processes
Differently, our goal is to represent a system with a part-whole hierarchy and discover the implied dependencies among intra-system variables: inferring the interactions that possess causal effects on the sub-system behavior with REcurrent partItioned Network (REIN).
VidFace: A Full-Transformer Solver for Video FaceHallucination with Unaligned Tiny Snapshots
In this paper, we investigate the task of hallucinating an authentic high-resolution (HR) human face from multiple low-resolution (LR) video snapshots.
OR-Net: Pointwise Relational Inference for Data Completion under Partial Observation
Specifically, we expect to approximate the real joint distribution over the partial observation and latent variables, thus infer the unseen targets respectively.
Learning Position and Target Consistency for Memory-based Video Object Segmentation
To address this limitation, we propose to Learn position and target Consistency framework for Memory-based video object segmentation, termed as LCM.
Stable Learning in Coding Space for Multi-Class Decoding and Its Extension for Multi-Class Hypothesis Transfer Learning
Many prevalent multi-class classification approaches can be unified and generalized by the output coding framework which usually consists of three phases: (1) coding, (2) learning binary classifiers, and (3) decoding.
