Search Results for author: Lei Shen

Found 28 papers, 2 papers with code

Few-Shot Table Understanding: A Benchmark Dataset and Pre-Training Baseline

no code implementations COLING 2022 Ruixue Liu, Shaozu Yuan, Aijun Dai, Lei Shen, Tiangang Zhu, Meng Chen, Xiaodong He

Since there is no large number of public Chinese tables, we also collect a large-scale, multi-domain tabular corpus to facilitate future Chinese table pre-training, which includes one million tables and related natural language text with auxiliary supervised interaction signals.

Constructing Emotional Consensus and Utilizing Unpaired Data for Empathetic Dialogue Generation

no code implementations Findings (EMNLP) 2021 Lei Shen, Jinchao Zhang, Jiao Ou, Xiaofang Zhao, Jie zhou

To address the above issues, we propose a dual-generative model, Dual-Emp, to simultaneously construct the emotional consensus and utilize some external unpaired data.

Dialogue Generation

CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Evaluations on HumanEval-X

1 code implementation30 Mar 2023 Qinkai Zheng, Xiao Xia, Xu Zou, Yuxiao Dong, Shan Wang, Yufei Xue, Zihan Wang, Lei Shen, Andi Wang, Yang Li, Teng Su, Zhilin Yang, Jie Tang

Large pre-trained code generation models, such as OpenAI Codex, can generate syntax- and function-correct code, making the coding of programmers more productive and our pursuit of artificial general intelligence closer.

Code Generation

DistilPose: Tokenized Pose Regression with Heatmap Distillation

1 code implementation4 Mar 2023 Suhang Ye, Yingyi Zhang, Jie Hu, Liujuan Cao, Shengchuan Zhang, Lei Shen, Jun Wang, Shouhong Ding, Rongrong Ji

Specifically, DistilPose maximizes the transfer of knowledge from the teacher model (heatmap-based) to the student model (regression-based) through Token-distilling Encoder (TDE) and Simulated Heatmaps.

Knowledge Distillation Pose Estimation +1

CECT: Controllable Ensemble CNN and Transformer for COVID-19 Image Classification

no code implementations5 Feb 2023 Zhaoshan Liu, Lei Shen

To relieve model performance limitations due to the lack of global (local) features, we develop a novel classification network CECT by controllable ensemble CNN and transformer.

Image Classification Medical Image Classification

Differentially Private Natural Language Models: Recent Advances and Future Directions

no code implementations22 Jan 2023 Lijie Hu, Ivan Habernal, Lei Shen, Di Wang

In this paper, we provide the first systematic review of recent advances on DP deep learning models in NLP.

Coordinating Cross-modal Distillation for Molecular Property Prediction

no code implementations30 Nov 2022 Hao Zhang, Nan Zhang, Ruixin Zhang, Lei Shen, Yingyi Zhang, Meng Liu

The existing graph methods have demonstrated that 3D geometric information is significant for better performance in MPP.

Graph Regression Graph Representation Learning +3

MNER-QG: An End-to-End MRC framework for Multimodal Named Entity Recognition with Query Grounding

no code implementations27 Nov 2022 Meihuizi Jia, Lei Shen, Xin Shen, Lejian Liao, Meng Chen, Xiaodong He, Zhendong Chen, Jiaqi Li

Multimodal named entity recognition (MNER) is a critical step in information extraction, which aims to detect entity spans and classify them to corresponding entity types given a sentence-image pair.

named-entity-recognition Named Entity Recognition +3

Recent Progress in Transformer-based Medical Image Analysis

no code implementations13 Aug 2022 Zhaoshan Liu, Qiujie Lv, Ziduo Yang, YiFan Li, Chau Hung Lee, Lei Shen

In this review, we first recap the core component of the transformer, the attention mechanism, and the detailed structures of the transformer.


Geometric Synthesis: A Free lunch for Large-scale Palmprint Recognition Model Pretraining

no code implementations11 Mar 2022 Kai Zhao, Lei Shen, Yingyi Zhang, Chuhan Zhou, Tao Wang, Ruixin Zhang, Shouhong Ding, Wei Jia, Wei Shen

In this paper, by observing that palmar creases are the key information to deep-learning-based palmprint recognition, we propose to synthesize training data by manipulating palmar creases.

GSDA: A Generative Adversarial Network-based Semi-Supervised Data Augmentation Method

no code implementations11 Mar 2022 Zhaoshan Liu, Qiujie Lv, Chau Hung Lee, Lei Shen

The GSDA is composed of the GAN and Convolutional Neural Network (CNN), in which GAN synthesizes and pseudo-labeled the US images with high resolution and high quality, and both real and synthesized images are employed to train CNN.

Data Augmentation Transfer Learning

Constructing Emotion Consensus and Utilizing Unpaired Data for Empathetic Dialogue Generation

no code implementations16 Sep 2021 Lei Shen, Jinchao Zhang, Jiao Ou, Xiaofang Zhao, Jie zhou

To address the above issues, we propose a dual-generative model, Dual-Emp, to simultaneously construct the emotion consensus and utilize some external unpaired data.

Dialogue Generation

Identifying Untrustworthy Samples: Data Filtering for Open-domain Dialogues with Bayesian Optimization

no code implementations14 Sep 2021 Lei Shen, Haolan Zhan, Xin Shen, Hongshen Chen, Xiaofang Zhao, Xiaodan Zhu

The training method updates parameters of a trained NCMs on two small sets with newly maintained and removed samples, respectively.

Dialogue Generation

GTM: A Generative Triple-Wise Model for Conversational Question Generation

no code implementations ACL 2021 Lei Shen, Fandong Meng, Jinchao Zhang, Yang Feng, Jie zhou

Generating some appealing questions in open-domain conversations is an effective way to improve human-machine interactions and lead the topic to a broader or deeper direction.

Question Generation Question-Generation

Probing Product Description Generation via Posterior Distillation

no code implementations2 Mar 2021 Haolan Zhan, Hainan Zhang, Hongshen Chen, Lei Shen, Zhuoye Ding, Yongjun Bao, Weipeng Yan, Yanyan Lan

To tackle this problem, we propose an adaptive posterior network based on Transformer architecture that can utilize user-cared information from customer reviews.

Learning to Select Context in a Hierarchical and Global Perspective for Open-domain Dialogue Generation

no code implementations18 Feb 2021 Lei Shen, Haolan Zhan, Xin Shen, Yang Feng

Open-domain multi-turn conversations mainly have three features, which are hierarchical semantic structure, redundant information, and long-term dependency.

Dialogue Generation Informativeness

User-Inspired Posterior Network for Recommendation Reason Generation

no code implementations16 Feb 2021 Haolan Zhan, Hainan Zhang, Hongshen Chen, Lei Shen, Yanyan Lan, Zhuoye Ding, Dawei Yin

A simple and effective way is to extract keywords directly from the knowledge-base of products, i. e., attributes or title, as the recommendation reason.

Question Answering

CDL: Curriculum Dual Learning for Emotion-Controllable Response Generation

no code implementations ACL 2020 Lei Shen, Yang Feng

Emotion-controllable response generation is an attractive and valuable task that aims to make open-domain conversations more empathetic and engaging.

Response Generation

A Charge-Density-Wave Topological Semimetal

no code implementations9 Sep 2019 Wujun Shi, Benjamin J. Wieder, H. L. Meyerheim, Yan Sun, Yang Zhang, Yiwei Li, Lei Shen, Yanpeng Qi, Lexian Yang, Jagannath Jena, Peter Werner, Klaus Koepernik, Stuart Parkin, Yulin Chen, Claudia Felser, B. Andrei Bernevig, Zhijun Wang

We here demonstrate that the room-temperature phase of (TaSe$_4$)$_2$I is a Weyl semimetal with 24 pairs of Weyl nodes.

Band Gap Materials Science Strongly Correlated Electrons

Accelerating Primal Solution Findings for Mixed Integer Programs Based on Solution Prediction

no code implementations23 Jun 2019 Jian-Ya Ding, Chao Zhang, Lei Shen, Shengyin Li, Bing Wang, Yinghui Xu, Le Song

In many applications, a similar MIP model is solved on a regular basis, maintaining remarkable similarities in model structures and solution appearances but differing in formulation coefficients.

Combinatorial Optimization

Modeling Semantic Relationship in Multi-turn Conversations with Hierarchical Latent Variables

no code implementations ACL 2019 Lei Shen, Yang Feng, Haolan Zhan

Multi-turn conversations consist of complex semantic structures, and it is still a challenge to generate coherent and diverse responses given previous utterances.

Intrinsic Ferromagnetism in Electrenes

no code implementations10 Apr 2019 Jun Zhou, Yuan Ping Feng, Lei Shen

We report intrinsic ferromagnetism in monolayer electrides or electrenes, in which excess electrons act as anions.

Computational Physics Materials Science

Empirical Evaluation of RNN Architectures on Sentence Classification Task

no code implementations29 Sep 2016 Lei Shen, Junlin Zhang

Recurrent Neural Networks have achieved state-of-the-art results for many problems in NLP and two most popular RNN architectures are Tail Model and Pooling Model.

Classification General Classification +1

Cannot find the paper you are looking for? You can Submit a new open access paper.