Search Results for author: Renjun Xu

Found 13 papers, 7 papers with code

Scientific Large Language Models: A Survey on Biological & Chemical Domains

1 code implementation26 Jan 2024 Qiang Zhang, Keyang Ding, Tianwen Lyv, Xinda Wang, Qingyu Yin, Yiwen Zhang, Jing Yu, Yuhao Wang, Xiaotong Li, Zhuoyi Xiang, Xiang Zhuang, Zeyuan Wang, Ming Qin, Mengyao Zhang, Jinlu Zhang, Jiyu Cui, Renjun Xu, Hongyang Chen, Xiaohui Fan, Huabin Xing, Huajun Chen

Large Language Models (LLMs) have emerged as a transformative power in enhancing natural language comprehension, representing a significant stride toward artificial general intelligence.

S2SNet: A Pretrained Neural Network for Superconductivity Discovery

1 code implementation28 Jun 2023 Ke Liu, Kaifan Yang, Jiahong Zhang, Renjun Xu

To the best of our knowledge, S2SNet is the first work to predict superconductivity with only information of crystal structures.

Electrical Engineering Language Modelling +1

$E(2)$-Equivariant Vision Transformer

1 code implementation11 Jun 2023 Renjun Xu, Kaifan Yang, Ke Liu, Fengxiang He

To address this issue, we design a Group Equivariant Vision Transformer (GE-ViT) via a novel, effective positional encoding operator.

Learning Universal User Representations via Self-Supervised Lifelong Behaviors Modeling

no code implementations29 Sep 2021 Bei Yang, Ke Liu, Xiaoxiao Xu, Renjun Xu, Hong Liu, Huan Xu

However, existing researches have little ability to model universal user representation based on lifelong behavior sequences since user registration.

Contrastive Learning Dimensionality Reduction +2

Interest-oriented Universal User Representation via Contrastive Learning

no code implementations18 Sep 2021 Qinghui Sun, Jie Gu, Bei Yang, Xiaoxiao Xu, Renjun Xu, Shangde Gao, Hong Liu, Huan Xu

Universal user representation has received many interests recently, with which we can be free from the cumbersome work of training a specific model for each downstream application.

Contrastive Learning Representation Learning +1

AdaRNN: Adaptive Learning and Forecasting of Time Series

2 code implementations10 Aug 2021 Yuntao Du, Jindong Wang, Wenjie Feng, Sinno Pan, Tao Qin, Renjun Xu, Chongjun Wang

This paper proposes Adaptive RNNs (AdaRNN) to tackle the TCS problem by building an adaptive model that generalizes well on the unseen test data.

Human Activity Recognition Time Series +1

Exploiting Adapters for Cross-lingual Low-resource Speech Recognition

2 code implementations18 May 2021 Wenxin Hou, Han Zhu, Yidong Wang, Jindong Wang, Tao Qin, Renjun Xu, Takahiro Shinozaki

Based on our previous MetaAdapter that implicitly leverages adapters, we propose a novel algorithms called SimAdapter for explicitly learning knowledge from adapters.

Cross-Lingual ASR General Knowledge +3

Learning Invariant Representations across Domains and Tasks

no code implementations3 Mar 2021 Jindong Wang, Wenjie Feng, Chang Liu, Chaohui Yu, Mingxuan Du, Renjun Xu, Tao Qin, Tie-Yan Liu

Being expensive and time-consuming to collect massive COVID-19 image samples to train deep classification models, transfer learning is a promising approach by transferring knowledge from the abundant typical pneumonia datasets for COVID-19 image classification.

Domain Adaptation Image Classification +1

Learning to Match Distributions for Domain Adaptation

1 code implementation17 Jul 2020 Chaohui Yu, Jindong Wang, Chang Liu, Tao Qin, Renjun Xu, Wenjie Feng, Yiqiang Chen, Tie-Yan Liu

However, it remains challenging to determine which method is suitable for a given application since they are built with certain priors or bias.

Domain Adaptation Inductive Bias

Joint Partial Optimal Transport for Open Set Domain Adaptation

no code implementations11 Jul 2020 Renjun Xu, Pelen Liu, Yin Zhang, Fang Cai, Jindong Wang, Shuoying Liang, Heting Ying, Jianwei Yin

However, in a general setting when the target domain contains classes that are never observed in the source domain, namely in Open Set Domain Adaptation (OSDA), existing DA methods failed to work because of the interference of the extra unknown classes.

Domain Adaptation

Reliable Weighted Optimal Transport for Unsupervised Domain Adaptation

no code implementations CVPR 2020 Renjun Xu, Pelen Liu, Liyan Wang, Chao Chen, Jindong Wang

Besides, the weighted optimal transport strategy based on SSR is exploited to achieve the precise-pair-wise optimal transport procedure, which reduces negative transfer brought by the samples near decision boundaries in the target domain.

Clustering Unsupervised Domain Adaptation

Cannot find the paper you are looking for? You can Submit a new open access paper.