Search Results for author:
Found 62 papers, 25 papers with code
Pinco: Position-induced Consistent Adapter for Diffusion Transformer in Foreground-conditioned Inpainting
Foreground-conditioned inpainting aims to seamlessly fill the background region of an image by utilizing the provided foreground subject and a text description.
MV-Adapter: Multi-view Consistent Image Generation Made Easy
To efficiently model the 3D geometric knowledge within the adapter, we introduce innovative designs that include duplicated self-attention layers and parallel attention architecture, enabling the adapter to inherit the powerful priors of the pre-trained models to model the novel 3D knowledge.
SuperMat: Physically Consistent PBR Material Estimation at Interactive Rates
We present SuperMat, a single-step framework that achieves high-quality material decomposition with one-step inference.
Textual Decomposition Then Sub-motion-space Scattering for Open-Vocabulary Motion Generation
For Textual Decomposition, we design a fine-grained description conversion algorithm, and combine it with the generalization ability of a large language model to convert any given motion text into atomic texts.
Rectified Diffusion Guidance for Conditional Generation
Classifier-Free Guidance (CFG), which combines the conditional and unconditional score functions with two coefficients summing to one, serves as a practical technique for diffusion model sampling.
AttentionPainter: An Efficient and Adaptive Stroke Predictor for Scene Painting
Stroke-based Rendering (SBR) aims to decompose an input image into a sequence of parameterized strokes, which can be rendered into a painting that resembles the input image.
Emphasizing Semantic Consistency of Salient Posture for Speech-Driven Gesture Generation
Specifically, we first learn a joint manifold space for the individual representation of audio and body pose to exploit the inherent semantic association between two modalities, and propose to enforce semantic consistency via a consistency loss.
AdR-Gaussian: Accelerating Gaussian Splatting with Adaptive Radius
In order to accelerate Gaussian splatting, we propose AdR-Gaussian, which moves part of serial culling in Render stage into the earlier Preprocess stage to enable parallel culling, employing adaptive radius to narrow the rendering pixel range for each Gaussian, and introduces a load balancing method to minimize thread waiting time during the pixel-parallel rendering.
SaRA: High-Efficient Diffusion Model Fine-tuning with Progressive Sparse Low-Rank Adaptation
Inspired by model pruning which lightens large pre-trained models by removing unimportant parameters, we propose a novel model fine-tuning method to make full use of these ineffective parameters and enable the pre-trained model with new task-specified capabilities.
PVP-Recon: Progressive View Planning via Warping Consistency for Sparse-View Surface Reconstruction
Neural implicit representations have revolutionized dense multi-view surface reconstruction, yet their performance significantly diminishes with sparse input views.
Portrait3D: 3D Head Generation from Single In-the-wild Portrait Image
We then use the canny map, ID features of the portrait image, and a pre-trained text-to-normal/depth diffusion model to generate ID-aware geometry supervision, and 3D-GAN inversion is employed to generate ID-aware geometry initialization.
SuperSVG: Superpixel-based Scalable Vector Graphics Synthesis
Then, we propose a two-stage self-training framework, where a coarse-stage model is employed to reconstruct the main structure and a refinement-stage model is used for enriching the details.
M3DM-NR: RGB-3D Noisy-Resistant Industrial Anomaly Detection via Multimodal Denoising
Existing industrial anomaly detection methods primarily concentrate on unsupervised learning with pristine RGB images.
FreeMotion: A Unified Framework for Number-free Text-to-Motion Synthesis
Text-to-motion synthesis is a crucial task in computer vision.
Ranked #5 on
Motion Synthesis
on InterHuman
GSTalker: Real-time Audio-Driven Talking Face Generation via Deformable Gaussian Splatting
We present GStalker, a 3D audio-driven talking face generation model with Gaussian Splatting for both fast training (40 minutes) and real-time rendering (125 FPS) with a 3$\sim$5 minute video for training material, in comparison with previous 2D and 3D NeRF-based modeling frameworks which require hours of training and seconds of rendering per frame.
MotionMaster: Training-free Camera Motion Transfer For Video Generation
Furthermore, we propose a few-shot camera motion disentanglement method to extract the common camera motion from multiple videos with similar camera motions, which employs a window-based clustering technique to extract the common features in temporal attention maps of multiple videos.
Learning Topology Uniformed Face Mesh by Volume Rendering for Multi-view Reconstruction
Our goal is to leverage the superiority of neural volume rendering into multi-view reconstruction of face mesh with consistent topology.
SDPose: Tokenized Pose Estimation via Circulation-Guide Self-Distillation
To mitigate the problem of under-fitting, we design a transformer module named Multi-Cycled Transformer(MCT) based on multiple-cycled forwards to more fully exploit the potential of small model parameters.
Continuous Piecewise-Affine Based Motion Model for Image Animation
To address this issue, we propose to model motion from the source image to the driving frame in highly-expressive diffeomorphism spaces.
Towards More Accurate Diffusion Model Acceleration with A Timestep Tuner
A diffusion model which is formulated to produce an image using thousands of denoising steps usually suffers from a slow inference speed.
Re-thinking Data Availability Attacks Against Deep Neural Networks
In this paper we re-examine the existing availability attack methods and propose a novel two-stage min-max-min optimization paradigm to generate robust unlearnable noise.
Automatic Tooth Arrangement with Joint Features of Point and Mesh Representations via Diffusion Probabilistic Models
To address this challenge, we propose a general tooth arrangement neural network based on the diffusion probabilistic model.
Plasticine3D: 3D Non-Rigid Editing with Text Guidance by Multi-View Embedding Optimization
With the help of Score Distillation Sampling (SDS) and the rapid development of neural 3D representations, some methods have been proposed to perform 3D editing such as adding additional geometries, or overwriting textures.
AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Model
Existing anomaly inspection methods are limited in their performance due to insufficient anomaly data.
SMaRt: Improving GANs with Score Matching Regularity
In this work, we revisit the mathematical foundations of GANs, and theoretically reveal that the native adversarial loss for GAN training is insufficient to fix the problem of subsets with positive Lebesgue measure of the generated data manifold lying out of the real data manifold.
SAMVG: A Multi-stage Image Vectorization Model with the Segment-Anything Model
Vector graphics are widely used in graphical designs and have received more and more attention.
Towards More Accurate Diffusion Model Acceleration with A Timestep Aligner
By viewing the generation of diffusion models as a discretized integrating process, we argue that the quality drop is partly caused by applying an inaccurate integral direction to a timestep interval.
T$^3$Bench: Benchmarking Current Progress in Text-to-3D Generation
Recent methods in text-to-3D leverage powerful pretrained diffusion models to optimize NeRF.
MMPI: a Flexible Radiance Field Representation by Multiple Multi-plane Images Blending
In this paper, we explore the potential of MPI and show that MPI can synthesize high-quality novel views of complex scenes with diverse camera distributions and view directions, which are not only limited to simple forward-facing scenes.
Contrastive Pseudo Learning for Open-World DeepFake Attribution
The challenge in sourcing attribution for forgery faces has gained widespread attention due to the rapid development of generative techniques.
Toward High Quality Facial Representation Learning
To improve the facial representation quality, we use feature map of a pre-trained visual backbone as a supervision item and use a partially pre-trained decoder for mask image modeling.
Phasic Content Fusing Diffusion Model with Directional Distribution Consistency for Few-Shot Model Adaption
To address these problems, we propose a novel phasic content fusing few-shot diffusion model with directional distribution consistency loss, which targets different learning objectives at distinct training stages of the diffusion model.
Stroke-based Neural Painting and Stylization with Dynamically Predicted Painting Region
To solve the problem, we propose Compositional Neural Painter, a novel stroke-based rendering framework which dynamically predicts the next painting region based on the current canvas, instead of dividing the image plane uniformly into painting regions.
LiDAR-Camera Panoptic Segmentation via Geometry-Consistent and Semantic-Aware Alignment
3D panoptic segmentation is a challenging perception task that requires both semantic segmentation and instance segmentation.
RFENet: Towards Reciprocal Feature Evolution for Glass Segmentation
Glass-like objects are widespread in daily life but remain intractable to be segmented for most existing methods.
Towards Generalizable Data Protection With Transferable Unlearnable Examples
One of the crucial factors contributing to this success has been the access to an abundance of high-quality data for constructing machine learning models.
Re-thinking Data Availablity Attacks Against Deep Neural Networks
The unauthorized use of personal data for commercial purposes and the clandestine acquisition of private data for training machine learning models continue to raise concerns.
Instance-Aware Domain Generalization for Face Anti-Spoofing
To address these issues, we propose a novel perspective for DG FAS that aligns features on the instance level without the need for domain labels.
Towards Artistic Image Aesthetics Assessment: a Large-scale Dataset and a New Method
To fill the gap in the field of artistic image aesthetics assessment (AIAA), we first introduce a large-scale AIAA dataset: Boldbrush Artistic Image Dataset (BAID), which consists of 60, 337 artistic images covering various art forms, with more than 360, 000 votes from online users.
Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior
In this work, we investigate the problem of creating high-fidelity 3D content from only a single image.
Multimodal Industrial Anomaly Detection via Hybrid Fusion
2D-based Industrial Anomaly Detection has been widely discussed, however, multimodal industrial anomaly detection based on 3D point clouds and RGB images still has many untouched fields.
Ranked #4 on
RGB+3D Anomaly Detection and Segmentation
on MVTEC 3D-AD
(using extra training data)
Contrastive Learning
RGB+3D Anomaly Detection and Segmentation
Remembering Normality: Memory-guided Knowledge Distillation for Unsupervised Anomaly Detection
Specifically, we first propose a normality recall memory (NR Memory) to strengthen the normality of student-generated features by recalling the stored normal information.
Ranked #14 on
Anomaly Detection
on MVTec AD
PCKRF: Point Cloud Completion and Keypoint Refinement With Fusion Data for 6D Pose Estimation
In this paper, we propose Point Cloud Completion and Keypoint Refinement with Fusion Data (PCKRF), a new pose refinement pipeline for 6D pose estimation.
Adaptive Mixture of Experts Learning for Generalizable Face Anti-Spoofing
Existing DG-based FAS approaches always capture the domain-invariant features for generalizing on the various unseen domains.
Generative Domain Adaptation for Face Anti-Spoofing
Most existing UDA FAS methods typically fit the trained models to the target domain via aligning the distribution of semantic high-level features.
Dynamic Neural Textures: Generating Talking-Face Videos with Continuously Controllable Expressions
In this paper, we propose a method to generate talking-face videos with continuously controllable expressions in real-time.
LAKe-Net: Topology-Aware Point Cloud Completion by Localizing Aligned Keypoints
An asymmetric keypoint locator, including an unsupervised multi-scale keypoint detector and a complete keypoint generator, is proposed for localizing aligned keypoints from complete and partial point clouds.
CtlGAN: Few-shot Artistic Portraits Generation with Contrastive Transfer Learning
We propose a new encoder which embeds real faces into Z+ space and proposes a dual-path training strategy to better cope with the adapted decoder and eliminate the artifacts.
Quality Metric Guided Portrait Line Drawing Generation from Unpaired Training Data
In this paper, we propose a novel method to automatically transform face photos to portrait drawings using unpaired training data with two new features; i. e., our method can (1) learn to generate high quality portrait drawings in multiple styles using a single network and (2) generate portrait drawings in a "new style" unseen in the training data.
Audio-Driven Talking Face Video Generation with Dynamic Convolution Kernels
In this paper, we present a dynamic convolution kernel (DCK) strategy for convolutional neural networks.
CFNet: Learning Correlation Functions for One-Stage Panoptic Segmentation
Recently, there is growing attention on one-stage panoptic segmentation methods which aim to segment instances and stuff jointly within a fully convolutional pipeline efficiently.
ISDNet: Integrating Shallow and Deep Networks for Efficient Ultra-High Resolution Segmentation
The huge burden of computation and memory are two obstacles in ultra-high resolution image segmentation.
Exploiting Fine-grained Face Forgery Clues via Progressive Enhancement Learning
The progressive enhancement process facilitates the learning of discriminative features with fine-grained face forgery clues.
Domain Adaptive Semantic Segmentation via Regional Contrastive Consistency Regularization
In this paper, we propose a novel and fully end-to-end trainable approach, called regional contrastive consistency regularization (RCCR) for domain adaptive semantic segmentation.
Infrastructure Assisted Constrained Connected Automated Vehicle Trajectory Optimization on Curved Roads: A Spatial Formulation on a Curvilinear Coordinate
This paper presents an infrastructure assisted constrained connected automated vehicles (CAVs) trajectory optimization method on curved roads.
NPRportrait 1.0: A Three-Level Benchmark for Non-Photorealistic Rendering of Portraits
Despite the recent upsurge of activity in image-based non-photorealistic rendering (NPR), and in particular portrait image stylisation, due to the advent of neural style transfer, the state of performance evaluation in this field is limited, especially compared to the norms in the computer vision and machine learning communities.
Unpaired Portrait Drawing Generation via Asymmetric Cycle Mapping
We observe that due to the significant imbalance of information richness between photos and drawings, existing unpaired transfer methods such as CycleGAN tends to embed invisible reconstruction information indiscriminately in the whole drawings, leading to important facial features partially missing in drawings.
3D-CariGAN: An End-to-End Solution to 3D Caricature Generation from Face Photos
The most challenging issue for our system is that the source domain of face photos (characterized by normal 2D faces) is significantly different from the target domain of 3D caricatures (characterized by 3D exaggerated face shapes and textures).
Audio-driven Talking Face Video Generation with Learning-based Personalized Head Pose
In this paper, we address this problem by proposing a deep neural network model that takes an audio signal A of a source person and a very short video V of a target person as input, and outputs a synthesized high-quality talking face video with personalized head pose (making use of the visual information in V), expression and lip synchronization (by considering both A and V).
A Configuration-Space Decomposition Scheme for Learning-based Collision Checking
Motion planning for robots of high degrees-of-freedom (DOFs) is an important problem in robotics with sampling-based methods in configuration space C as one popular solution.
APDrawingGAN: Generating Artistic Portrait Drawings From Face Photos With Hierarchical GANs
Moreover, artists tend to use different strategies to draw different facial features and the lines drawn are only loosely related to obvious image features.
Content-Sensitive Supervoxels via Uniform Tessellations on Video Manifolds
We propose an efficient Lloyd-like method with a splitting-merging scheme to compute a uniform tessellation on M, which induces the CSS in X. Theoretically our method has a good competitive ratio O(1).
