Search Results for author:
Found 19 papers, 8 papers with code
HunyuanVideo: A Systematic Framework For Large Video Generative Models
In this report, we introduce HunyuanVideo, an innovative open-source video foundation model that demonstrates performance in video generation comparable to, or even surpassing, that of leading closed-source models.
Follow-Your-Canvas: Higher-Resolution Video Outpainting with Extensive Content Generation
Coupling with these two designs enables us to generate higher-resolution outpainting videos with rich content while keeping spatial and temporal consistency.
Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animation
We present Follow-Your-Emoji, a diffusion-based framework for portrait animation, which animates a reference portrait with target landmark sequences.
HAP: Structure-Aware Masked Image Modeling for Human-Centric Perception
To further capture human characteristics, we propose a structure-invariant alignment loss that enforces different masked views, guided by the human part prior, to be closely aligned for the same image.
Understanding Prompt Tuning for V-L Models Through the Lens of Neural Collapse
It is found that NC optimality of text-to-image representations shows a positive correlation with downstream generalizability, which is more severe under class imbalance settings.
Quantitatively Measuring and Contrastively Exploring Heterogeneity for Domain Generalization
With contrastive learning, we propose a learning potential-guided metric for domain heterogeneity by promoting learning variant features.
Universal Domain Adaptation via Compressive Attention Matching
To address this issue, we propose a Universal Attention Matching (UniAM) framework by exploiting the self-attention mechanism in vision transformer to capture the crucial object information.
Ranked #1 on
Universal Domain Adaptation
on Office-31
Task-Oriented Multi-Modal Mutual Leaning for Vision-Language Models
A contrastive loss is employed to align such augmented text and image representations on downstream tasks.
MAP: Towards Balanced Generalization of IID and OOD through Model-Agnostic Adapters
To achieve this goal, we apply a bilevel optimization to explicitly model and optimize the coupling relationship between the OOD model and auxiliary adapter layers.
CAE v2: Context Autoencoder with CLIP Target
That is to say, the smaller the model, the lower the mask ratio needs to be.
Domain Generalization via Contrastive Causal Learning
Specifically, CCM is composed of three components: (i) domain-conditioned supervised learning which teaches CCM the correlation between images and labels, (ii) causal effect learning which helps CCM measure the true causal effects of images to labels, (iii) contrastive similarity learning which clusters the features of images that belong to the same class and provides the quantification of similarity.
Label-Efficient Domain Generalization via Collaborative Exploration and Generalization
To escape from the dilemma between domain generalization and annotation costs, in this paper, we introduce a novel task named label-efficient domain generalization (LEDG) to enable model generalization with label-limited source domains.
Attention-based Cross-Layer Domain Alignment for Unsupervised Domain Adaptation
To further boost model adaptation performance, we propose a novel method called Attention-based Cross-layer Domain Alignment (ACDA), which captures the semantic relationship between the source and target domains across model layers and calibrates each level of semantic information automatically through a dynamic attention mechanism.
Collaborative Semantic Aggregation and Calibration for Federated Domain Generalization
Domain generalization (DG) aims to learn from multiple known source domains a model that can generalize well to unknown target domains.
Instrumental Variable-Driven Domain Generalization with Unobserved Confounders
Meanwhile, the existing of unobserved confounders which affect the input features and labels simultaneously cause spurious correlation and hinder the learning of the invariant relationship contained in the conditional distribution.
Domain-Specific Bias Filtering for Single Labeled Domain Generalization
In this paper, we investigate a Single Labeled Domain Generalization (SLDG) task with only one source domain being labeled, which is more practical and challenging than the CDG task.
Auto IV: Counterfactual Prediction via Automatic Instrumental Variable Decomposition
We also learn confounder representations by encouraging them to be relevant to both the treatment and the outcome.
Learning Decomposed Representation for Counterfactual Inference
The fundamental problem in treatment effect estimation from observational data is confounder identification and balancing.
Subgraph Networks with Application to Structural Feature Space Expansion
In other words, the structural features of SGNs can complement that of the original network for better network classification, regardless of the feature extraction method used, such as the handcrafted, network embedding and kernel-based methods.
Ranked #10 on
Graph Classification
on MUTAG
