Search Results for author:
Found 15 papers, 13 papers with code
DPMesh: Exploiting Diffusion Prior for Occluded Human Mesh Recovery
The recovery of occluded human meshes presents challenges for current methods due to the difficulty in extracting effective image features under severe occlusion.
MaskINT: Video Editing via Interpolative Non-autoregressive Masked Transformers
Recent advances in generative AI have significantly enhanced image and video editing, particularly in the context of text prompt control.
OpenVoice: Versatile Instant Voice Cloning
The voice styles are not directly copied from and constrained by the style of the reference speaker.
Unleashing Text-to-Image Diffusion Models for Visual Perception
In this paper, we propose VPD (Visual Perception with a pre-trained Diffusion model), a new framework that exploits the semantic information of a pre-trained text-to-image diffusion model in visual perception tasks.
Ranked #7 on
Referring Expression Segmentation
on RefCoCo val
DiffTalk: Crafting Diffusion Models for Generalized Audio-Driven Portraits Animation
In this way, the proposed DiffTalk is capable of producing high-quality talking head videos in synchronization with the source audio, and more importantly, it can be naturally generalized across different identities without any further fine-tuning.
DiffSwap: High-Fidelity and Controllable Face Swapping via 3D-Aware Masked Diffusion
Unlike previous work that relies on carefully designed network architectures and loss functions to fuse the information from the source and target faces, we reformulate the face swapping as a conditional inpainting task, performed by a powerful diffusion model guided by the desired face attributes (e. g., identity and landmarks).
HorNet: Efficient High-Order Spatial Interactions with Recursive Gated Convolutions
In this paper, we show that the key ingredients behind the vision Transformers, namely input-adaptive, long-range and high-order spatial interactions, can also be efficiently implemented with a convolution-based framework.
Ranked #20 on
Semantic Segmentation
on ADE20K
Dynamic Spatial Sparsification for Efficient Vision Transformers and Convolutional Neural Networks
We extend our method to hierarchical models including CNNs and hierarchical vision Transformers as well as more complex dense prediction tasks that require structured feature maps by formulating a more generic dynamic spatial sparsification framework with progressive sparsification and asymmetric computation for different spatial locations.
A Roadmap for Big Model
With the rapid development of deep learning, training Big Models (BMs) for multiple downstream tasks becomes a popular paradigm.
DenseCLIP: Language-Guided Dense Prediction with Context-Aware Prompting
In this work, we present a new framework for dense prediction by implicitly and explicitly leveraging the pre-trained knowledge from CLIP.
Group-aware Contrastive Regression for Action Quality Assessment
Assessing action quality is challenging due to the subtle differences between videos and large variations in scores.
Ranked #2 on
Action Quality Assessment
on MTL-AQA
Towards Interpretable Deep Metric Learning with Structural Matching
Our method is model-agnostic, which can be applied to off-the-shelf backbone networks and metric learning methods.
Ranked #16 on
Metric Learning
on CUB-200-2011
Global Filter Networks for Image Classification
Recent advances in self-attention and pure multi-layer perceptrons (MLP) models for vision have shown great potential in achieving promising performance with fewer inductive biases.
Ranked #9 on
Image Classification
on Stanford Cars
(using extra training data)
DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsification
Based on this observation, we propose a dynamic token sparsification framework to prune redundant tokens progressively and dynamically based on the input.
Ranked #3 on
Efficient ViTs
on ImageNet-1K (With LV-ViT-S)
Field-weighted Factorization Machines for Click-Through Rate Prediction in Display Advertising
The data involved in CTR prediction are typically multi-field categorical data, i. e., every feature is categorical and belongs to one and only one field.
