Search Results for author:
Found 24 papers, 15 papers with code
MoRA: LoRA Guided Multi-Modal Disease Diagnosis with Missing Modality
MoRA projects each input to a low intrinsic dimension but uses different modality-aware up-projections for modality-specific adaptation in cases of missing modalities.
REPARO: Compositional 3D Assets Generation with Differentiable 3D Layout Alignment
Traditional image-to-3D models often struggle with scenes containing multiple objects due to biases and occlusion complexities.
Joint-Task Regularization for Partially Labeled Multi-Task Learning
Multi-task learning has become increasingly popular in the machine learning field, but its practicality is hindered by the need for large, labeled datasets.
R^2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding
Video temporal grounding (VTG) is a fine-grained video understanding problem that aims to ground relevant clips in untrimmed videos given natural language queries.
$R^2$-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding
Video temporal grounding (VTG) is a fine-grained video understanding problem that aims to ground relevant clips in untrimmed videos given natural language queries.
Ranked #2 on
Highlight Detection
on QVHighlights
TriSAM: Tri-Plane SAM for zero-shot cortical blood vessel segmentation in VEM images
While imaging techniques at macro and mesoscales have garnered substantial attention and resources, microscale Volume Electron Microscopy (vEM) imaging, capable of revealing intricate vascular details, has lacked the necessary benchmarking infrastructure.
LangSplat: 3D Language Gaussian Splatting
Humans live in a 3D world and commonly use natural language to interact with a 3D scene.
CLIPTrans: Transferring Visual Knowledge with Pre-trained Models for Multimodal Machine Translation
Simultaneously, there has been an influx of multilingual pre-trained models for NMT and multimodal pre-trained models for vision-language tasks, primarily in English, which have shown exceptional generalisation ability.
DiffTalk: Crafting Diffusion Models for Generalized Audio-Driven Portraits Animation
In this way, the proposed DiffTalk is capable of producing high-quality talking head videos in synchronization with the source audio, and more importantly, it can be naturally generalized across different identities without any further fine-tuning.
CLIP-Cluster: CLIP-Guided Attribute Hallucination for Face Clustering
Furthermore, we develop a neighbor-aware proxy generator that fuses the features describing various attributes into a proxy feature to build a bridge among different sub-clusters and reduce the intra-class variance.
Learning Dynamic Facial Radiance Fields for Few-Shot Talking Head Synthesis
Thus the facial radiance field can be flexibly adjusted to the new identity with few reference images.
Label2Label: A Language Modeling Framework for Multi-Attribute Learning
As each sample is annotated with multiple attribute labels, these "words" will naturally form an unordered but meaningful "sentence", which depicts the semantic information of the corresponding sample.
MetaAge: Meta-Learning Personalized Age Estimators
Unlike most existing personalized methods that learn the parameters of a personalized estimator for each person in the training set, our method learns the mapping from identity information to age estimator parameters.
Ranked #1 on
Age Estimation
on ChaLearn 2015
OrdinalCLIP: Learning Rank Prompts for Language-Guided Ordinal Regression
In this paper, we propose to learn the rank concepts from the rich semantic CLIP latent space.
Ranked #1 on
Few-shot Age Estimation
on MORPH Album2
3rd Place Scheme on Instance Segmentation Track of ICCV 2021 VIPriors Challenges
In the end, our team achieved the result of 0. 366 for AP@0. 50:0. 95 on the test set, which is competitive with other top-ranking methods while only one GPU is used.
Reasoning Graph Networks for Kinship Verification: from Star-shaped to Hierarchical
To address this, we propose a Star-shaped Reasoning Graph Network (S-RGN).
Ranked #1 on
Kinship Verification
on KinFaceW-I
Structure-Aware Face Clustering on a Large-Scale Graph With 107 Nodes
To address the dilemma of large-scale training and efficient inference, we propose the STructure-AwaRe Face Clustering (STAR-FC) method.
Meta-Mining Discriminative Samples for Kinship Verification
In the end, the samples in the unbalanced train batch are re-weighted by the learned meta-miner to optimize the kinship models.
Ranked #1 on
Kinship Verification
on KinFaceW-II
Learning Probabilistic Ordinal Embeddings for Uncertainty-Aware Regression
An ordinal distribution constraint is proposed to exploit the ordinal nature of regression.
Ranked #2 on
Age Estimation
on Adience
Aesthetics Quality Assessment
Age And Gender Classification
+3
Structure-Aware Face Clustering on a Large-Scale Graph with $\bf{10^{7}}$ Nodes
To address the dilemma of large-scale training and efficient inference, we propose the STructure-AwaRe Face Clustering (STAR-FC) method.
Frequency-Aware Spatiotemporal Transformers for Video Inpainting Detection
In this paper, we propose a frequency-aware spatiotemporal transformers for deep In this paper, we propose a Frequency-Aware Spatiotemporal Transformer (FAST) for video inpainting detection, which aims to simultaneously mine the traces of video inpainting from spatial, temporal, and frequency domains.
Graph-Based Social Relation Reasoning
Human beings are fundamentally sociable -- that we generally organize our social lives in terms of relations with other people.
Ranked #1 on
Visual Social Relationship Recognition
on PIPA
Graph-based Kinship Reasoning Network
In this paper, we propose a graph-based kinship reasoning (GKR) network for kinship verification, which aims to effectively perform relational reasoning on the extracted features of an image pair.
Ranked #3 on
Kinship Verification
on KinFaceW-II
BridgeNet: A Continuity-Aware Probabilistic Network for Age Estimation
Existing methods for age estimation usually apply a divide-and-conquer strategy to deal with heterogeneous data caused by the non-stationary aging process.
Ranked #2 on
Age Estimation
on FGNET
