Search Results for author: Xingyi Cheng

Found 19 papers, 9 papers with code

MSAGPT: Neural Prompting Protein Structure Prediction via MSA Generative Pre-Training

1 code implementation8 Jun 2024 Bo Chen, Zhilei Bei, Xingyi Cheng, Pan Li, Jie Tang, Le Song

Multiple Sequence Alignment (MSA) plays a pivotal role in unveiling the evolutionary trajectories of protein families.

Few-Shot Learning Multiple Sequence Alignment +2

xTrimoPGLM: Unified 100B-Scale Pre-trained Transformer for Deciphering the Language of Protein

no code implementations11 Jan 2024 Bo Chen, Xingyi Cheng, Pan Li, Yangli-ao Geng, Jing Gong, Shen Li, Zhilei Bei, Xu Tan, Boyan Wang, Xin Zeng, Chiming Liu, Aohan Zeng, Yuxiao Dong, Jie Tang, Le Song

We propose a unified protein language model, xTrimoPGLM, to address these two types of tasks simultaneously through an innovative pre-training framework.

Protein Language Model

Linker-Tuning: Optimizing Continuous Prompts for Heterodimeric Protein Prediction

no code implementations2 Dec 2023 Shuxian Zou, Hui Li, Shentong Mo, Xingyi Cheng, Eric Xing, Le Song

Predicting the structure of interacting chains is crucial for understanding biological systems and developing new drugs.

Protein Structure Prediction

Won't Get Fooled Again: Answering Questions with False Premises

1 code implementation5 Jul 2023 Shengding Hu, Yifan Luo, Huadong Wang, Xingyi Cheng, Zhiyuan Liu, Maosong Sun

In this paper, we find that the PLMs already possess the knowledge required to rebut such questions, and the key is how to activate the knowledge.

Question Answering

K-AID: Enhancing Pre-trained Language Models with Domain Knowledge for Question Answering

no code implementations22 Sep 2021 Fu Sun, Feng-Lin Li, Ruize Wang, Qianglong Chen, Xingyi Cheng, Ji Zhang

Knowledge enhanced pre-trained language models (K-PLMs) are shown to be effective for many public tasks in the literature but few of them have been successfully applied in practice.

Knowledge Distillation Question Answering +4

Evaluating Modules in Graph Contrastive Learning

1 code implementation15 Jun 2021 Ganqu Cui, Yufeng Du, Cheng Yang, Jie zhou, Liang Xu, Xing Zhou, Xingyi Cheng, Zhiyuan Liu

The recent emergence of contrastive learning approaches facilitates the application on graph representation learning (GRL), introducing graph contrastive learning (GCL) into the literature.

Contrastive Learning Graph Classification +1

Dual-View Distilled BERT for Sentence Embedding

no code implementations18 Apr 2021 Xingyi Cheng

In this paper, we propose a Dual-view distilled BERT~(DvBERT) for sentence matching with sentence embeddings.

Sentence Sentence Embedding +2

Question Directed Graph Attention Network for Numerical Reasoning over Text

no code implementations EMNLP 2020 Kunlong Chen, Weidi Xu, Xingyi Cheng, Zou Xiaochuan, Yuyu Zhang, Le Song, Taifeng Wang, Yuan Qi, Wei Chu

Numerical reasoning over texts, such as addition, subtraction, sorting and counting, is a challenging machine reading comprehension task, since it requires both natural language understanding and arithmetic computation.

Graph Attention Machine Reading Comprehension +2

A Workflow for Exploring Ligand Dissociation from a Macromolecule: Efficient Random Acceleration Molecular Dynamics Simulation and Interaction Fingerprints Analysis of Ligand Trajectories

1 code implementation19 Jun 2020 Daria B. Kokha, Bernd Doser, Stefan Richter, Fabian Ormersbach, Xingyi Cheng, Rebecca C. Wade

The combined implementation of RAMD and MD-IFP provides a computationally efficient and freely available workflow that can be applied to hundreds of compounds in a reasonable computational time and will facilitate the use of tauRAMD in drug design.

SpellGCN: Incorporating Phonological and Visual Similarities into Language Models for Chinese Spelling Check

1 code implementation ACL 2020 Xingyi Cheng, Weidi Xu, Kunlong Chen, Shaohua Jiang, Feng Wang, Taifeng Wang, Wei Chu, Yuan Qi

This paper proposes to incorporate phonological and visual similarity knowledge into language models for CSC via a specialized graph convolutional network (SpellGCN).

Symmetric Regularization based BERT for Pair-wise Semantic Reasoning

1 code implementation8 Sep 2019 Weidi Xu, Xingyi Cheng, Kunlong Chen, Wei Wang, Bin Bi, Ming Yan, Chen Wu, Luo Si, Wei Chu, Taifeng Wang

To remedy this, we propose to augment the NSP task to a 3-class categorization task, which includes a category for previous sentence prediction (PSP).

Machine Reading Comprehension Natural Language Inference +2

BERT-Based Multi-Head Selection for Joint Entity-Relation Extraction

1 code implementation16 Aug 2019 Weipeng Huang, Xingyi Cheng, Taifeng Wang, Wei Chu

Combining these three contributions, we enhance the information extracting ability of the multi-head selection model and achieve F1-score 0. 876 on testset-1 with a single model.

Relation Relation Extraction

An end-to-end Neural Network Framework for Text Clustering

no code implementations22 Mar 2019 Jie Zhou, Xingyi Cheng, Jinchao Zhang

Conventional \mbox{methods} generally treat this task using separated steps, including text representation learning and clustering the representations.

Clustering Representation Learning +3

Variational Semi-supervised Aspect-term Sentiment Analysis via Transformer

no code implementations CONLL 2019 Xingyi Cheng, Weidi Xu, Taifeng Wang, Wei Chu

By disentangling the latent representation into the aspect-specific sentiment and the lexical context, our method induces the underlying sentiment prediction for the unlabeled data, which then benefits the ATSA classifier.

Aspect-Based Sentiment Analysis (ABSA) Natural Language Understanding +1

DeepTransport: Learning Spatial-Temporal Dependency for Traffic Condition Forecasting

1 code implementation27 Sep 2017 Xingyi Cheng, Ruiqing Zhang, Jie zhou, Wei Xu

Several pioneering approaches have been proposed based on traffic observations of the target location as well as its adjacent regions, but they obtain somewhat limited accuracy due to a lack of mining road topology.

Cannot find the paper you are looking for? You can Submit a new open access paper.