Search Results for author:
Found 22 papers, 6 papers with code
Tencent Translation System for the WMT21 News Translation Task
Based on our success in the last WMT, we continuously employed advanced techniques such as large batch training, data selection and data filtering.
Recurrent Attention for Neural Machine Translation
Across an extensive set of experiments on 10 machine translation tasks, we find that RAN models are competitive and outperform their Transformer counterpart in certain scenarios, with fewer parameters and inference time.
Tencent Neural Machine Translation Systems for the WMT20 News Translation Task
This paper describes Tencent Neural Machine Translation systems for the WMT 2020 news translation tasks.
Modeling Multi-Granularity Hierarchical Features for Relation Extraction
In this paper, we propose a novel method to extract multi-granularity features based solely on the original input sentences.
Learning Confidence for Transformer-based Neural Machine Translation
Confidence estimation aims to quantify the confidence of the model prediction, providing an expectation of success.
Task-guided Disentangled Tuning for Pretrained Language Models
Pretrained language models (PLMs) trained on large-scale unlabeled corpus are typically fine-tuned on task-specific downstream datasets, which have produced state-of-the-art results on various NLP tasks.
SkillNet-NLU: A Sparsely Activated Model for General-Purpose Natural Language Understanding
The key feature of our approach is that it is sparsely activated guided by predefined skills.
Pretraining without Wordpieces: Learning Over a Vocabulary of Millions of Words
(2) how to predict a word via cloze test without knowing the number of wordpieces in advance?
Unsupervised Keyphrase Extraction by Jointly Modeling Local and Global Context
In terms of the local view, we first build a graph structure based on the document where phrases are regarded as vertices and the edges are similarities between vertices.
Attention Calibration for Transformer in Neural Machine Translation
Attention mechanisms have achieved substantial improvements in neural machine translation by dynamically selecting relevant inputs for different predictions.
Robust Machine Reading Comprehension by Learning Soft labels
Neural models have achieved great success on the task of machine reading comprehension (MRC), which are typically trained on hard labels.
Emotion Classification by Jointly Learning to Lexiconize and Classify
Emotion lexicons have been shown effective for emotion classification (Baziotis et al., 2018).
Improving Machine Reading Comprehension with Single-choice Decision and Transfer Learning
In addition, by transferring knowledge from other kinds of MRC tasks, our model achieves a new state-of-the-art results in both single and ensemble settings.
Ranked #1 on
Reading Comprehension
on RACE
Source Dependency-Aware Transformer with Supervised Self-Attention
Recently, Transformer has achieved the state-of-the-art performance on many machine translation tasks.
Accelerating Transformer Decoding via a Hybrid of Self-attention and Recurrent Neural Network
Due to the highly parallelizable architecture, Transformer is faster to train than RNN-based models and popularly used in machine translation tasks.
Learning Unsupervised Word Mapping by Maximizing Mean Discrepancy
In order to avoid such sophisticated alternate optimization, we propose to learn unsupervised word mapping by directly maximizing the mean discrepancy between the distribution of transferred embedding and target embedding.
Regularizing Neural Machine Translation by Target-bidirectional Agreement
Although Neural Machine Translation (NMT) has achieved remarkable progress in the past several years, most NMT systems still suffer from a fundamental shortcoming as in other sequence generation tasks: errors made early in generation process are fed as inputs to the model and can be quickly amplified, harming subsequent sequence generation.
Achieving Human Parity on Automatic Chinese to English News Translation
Machine translation has made rapid advances in recent years.
Ranked #3 on
Machine Translation
on WMT 2017 English-Chinese
Sequence-to-Dependency Neural Machine Translation
Nowadays a typical Neural Machine Translation (NMT) model generates translations from left to right as a linear sequence, during which latent syntactic structures of the target sentences are not explicitly concerned.
