Search Results for author:
Found 16 papers, 4 papers with code
Multimodal Music Generation with Explicit Bridges and Retrieval Augmentation
Multimodal music generation aims to produce music from diverse input modalities, including text, videos, and images.
FreeEdit: Mask-free Reference-based Image Editing with Multi-modal Instruction
We propose FreeEdit, a novel approach for achieving such reference-based image editing, which can accurately reproduce the visual concept from the reference image based on user-friendly language instructions.
Learning to Discover Forgery Cues for Face Forgery Detection
The produced manipulation maps can serve as better supervision to enhance face forgery detectors.
Unveiling Structural Memorization: Structural Membership Inference Attack for Text-to-Image Diffusion Models
Therefore, in order to judge whether a specific image is utilized as a member of a model's training set, Membership Inference Attack (MIA) is proposed to serve as a tool for privacy protection.
Explicit Correlation Learning for Generalizable Cross-Modal Deepfake Detection
With the rising prevalence of deepfakes, there is a growing interest in developing generalizable detection methods for various types of deepfakes.
Model Will Tell: Training Membership Inference for Diffusion Models
In this paper, we explore a novel perspective for the TMI task by leveraging the intrinsic generative priors within the diffusion model.
Customize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Training
In this paper, we target the adaptive source driven 3D scene editing task by proposing a CustomNeRF model that unifies a text description or a reference image as the editing prompt.
Enriching Phrases with Coupled Pixel and Object Contexts for Panoptic Narrative Grounding
Panoptic narrative grounding (PNG) aims to segment things and stuff objects in an image described by noun phrases of a narrative caption.
OSM-Net: One-to-Many One-shot Talking Head Generation with Spontaneous Head Motions
Other works construct one-to-one mapping between audio signal and head motion sequences, introducing ambiguity correspondences into the mapping since people can behave differently in head motions when speaking the same content.
Discovering Sounding Objects by Audio Queries for Audio Visual Segmentation
Explicit object-level semantic correspondence between audio and visual modalities is established by gathering object information from visual features with predefined audio queries.
MFR-Net: Multi-faceted Responsive Listening Head Generation via Denoising Diffusion Model
Responsive listening head generation is an important task that aims to model face-to-face communication scenarios by generating a listener head video given a speaker video and a listener head image.
FONT: Flow-guided One-shot Talking Head Generation with Natural Head Motions
Specifically, the head pose prediction module is designed to generate head pose sequences from the source face and driving audio.
OPT: One-shot Pose-Controllable Talking Head Generation
To solve the identity mismatch problem and achieve high-quality free pose control, we present One-shot Pose-controllable Talking head generation network (OPT).
Anchor3DLane: Learning to Regress 3D Anchors for Monocular 3D Lane Detection
An attempt has been made to get rid of BEV and predict 3D lanes from FV representations directly, while it still underperforms other BEV-based methods given its lack of structured representation for 3D lanes.
Ranked #4 on
3D Lane Detection
on Apollo Synthetic 3D Lane
Bridging Search Region Interaction With Template for RGB-T Tracking
To alleviate these limitations, we propose a novel Template-Bridged Search region Interaction (TBSI) module which exploits templates as the medium to bridge the cross-modal interaction between RGB and TIR search regions by gathering and distributing target-relevant object and environment contexts.
Ranked #12 on
Rgb-T Tracking
on RGBT210
LI-Net: Large-Pose Identity-Preserving Face Reenactment Network
Face reenactment is a challenging task, as it is difficult to maintain accurate expression, pose and identity simultaneously.
