Search Results for author: Weimin Wu

Found 2 papers, 1 papers with code

DNABERT-S: Learning Species-Aware DNA Embedding with Genome Foundation Models

1 code implementation13 Feb 2024 Zhihan Zhou, Weimin Wu, Harrison Ho, Jiayi Wang, Lizhen Shi, Ramana V Davuluri, Zhong Wang, Han Liu

To encourage effective embeddings to error-prone long-read DNA sequences, we introduce Manifold Instance Mixup (MI-Mix), a contrastive objective that mixes the hidden representations of DNA sequences at randomly selected layers and trains the model to recognize and differentiate these mixed proportions at the output layer.

Contrastive Learning

Instance-aware Model Ensemble With Distillation For Unsupervised Domain Adaptation

no code implementations15 Nov 2022 Weimin Wu, Jiayuan Fan, Tao Chen, Hancheng Ye, Bo Zhang, Baopu Li

To enhance the model, adaptability between domains and reduce the computational cost when deploying the ensemble model, we propose a novel framework, namely Instance aware Model Ensemble With Distillation, IMED, which fuses multiple UDA component models adaptively according to different instances and distills these components into a small model.

Knowledge Distillation Unsupervised Domain Adaptation

Cannot find the paper you are looking for? You can Submit a new open access paper.