Search Results for author: Sufeng Duan

Found 10 papers, 2 papers with code

Improving Non-autoregressive Machine Translation with Error Exposure and Consistency Regularization

no code implementations15 Feb 2024 Xinran Chen, Sufeng Duan, Gongshen Liu

Being one of the IR-NAT (Iterative-refinemennt-based NAT) frameworks, the Conditional Masked Language Model (CMLM) adopts the mask-predict paradigm to re-predict the masked low-confidence tokens.

Language Modelling Machine Translation +1

Multi-grained Evidence Inference for Multi-choice Reading Comprehension

no code implementations27 Oct 2023 Yilin Zhao, Hai Zhao, Sufeng Duan

Multi-choice Machine Reading Comprehension (MRC) is a major and challenging task for machines to answer questions according to provided options.

Machine Reading Comprehension Multi-Choice MRC +1

To Understand Representation of Layer-aware Sequence Encoders as Multi-order-graph

no code implementations16 Jan 2021 Sufeng Duan, Hai Zhao

We also propose a revisited multigraph called Multi-order-Graph (MoG) based on our explanation to model the graph structures in the SAN-based model as subgraphs in MoG and convert the encoding of SAN-based model to the generation of MoG.

Machine Translation Sentence +1

SG-Net: Syntax Guided Transformer for Language Representation

no code implementations27 Dec 2020 Zhuosheng Zhang, Yuwei Wu, Junru Zhou, Sufeng Duan, Hai Zhao, Rui Wang

In detail, for self-attention network (SAN) sponsored Transformer-based encoder, we introduce syntactic dependency of interest (SDOI) design into the SAN to form an SDOI-SAN with syntax-guided self-attention.

Machine Reading Comprehension Machine Translation +2

Graph-to-Sequence Neural Machine Translation

no code implementations16 Sep 2020 Sufeng Duan, Hai Zhao, Rui Wang

In the light of the current NMT models more or less capture graph information among the sequence in a latent way, we present a graph-to-sequence model facilitating explicit graph information capturing.

Graph-to-Sequence Machine Translation +3

Capsule-Transformer for Neural Machine Translation

no code implementations30 Apr 2020 Sufeng Duan, Juncheng Cao, Hai Zhao

In this paper, we thus propose the capsule-Transformer, which extends the linear transformation into a more general capsule routing algorithm by taking SAN as a special case of capsule network.

Machine Translation Translation

Syntax-aware Data Augmentation for Neural Machine Translation

no code implementations29 Apr 2020 Sufeng Duan, Hai Zhao, Dong-dong Zhang, Rui Wang

Data augmentation is an effective performance enhancement in neural machine translation (NMT) by generating additional bilingual data.

Data Augmentation Machine Translation +3

Attention Is All You Need for Chinese Word Segmentation

1 code implementation EMNLP 2020 Sufeng Duan, Hai Zhao

Taking greedy decoding algorithm as it should be, this work focuses on further strengthening the model itself for Chinese word segmentation (CWS), which results in an even more fast and more accurate CWS model.

Chinese Word Segmentation Segmentation

SG-Net: Syntax-Guided Machine Reading Comprehension

1 code implementation14 Aug 2019 Zhuosheng Zhang, Yuwei Wu, Junru Zhou, Sufeng Duan, Hai Zhao, Rui Wang

In detail, for self-attention network (SAN) sponsored Transformer-based encoder, we introduce syntactic dependency of interest (SDOI) design into the SAN to form an SDOI-SAN with syntax-guided self-attention.

Language Modelling Machine Reading Comprehension +1

Fast Neural Chinese Word Segmentation for Long Sentences

no code implementations6 Nov 2018 Sufeng Duan, Jiangtong Li, Hai Zhao

Rapidly developed neural models have achieved competitive performance in Chinese word segmentation (CWS) as their traditional counterparts.

Chinese Word Segmentation Segmentation +1

Cannot find the paper you are looking for? You can Submit a new open access paper.