Search Results for author:
Found 19 papers, 1 papers with code
HW-TSC’s Participation at WMT 2021 Quality Estimation Shared Task
This paper presents our work in WMT 2021 Quality Estimation (QE) Shared Task.
Make the Blind Translator See The World: A Novel Transfer Learning Solution for Multimodal Machine Translation
Based on large-scale pretrained networks and the liability to be easily overfitting with limited labelled training data of multimodal translation (MMT) is a critical issue in MMT.
HW-TSC’s Participation at WMT 2020 Automatic Post Editing Shared Task
The paper presents the submission by HW-TSC in the WMT 2020 Automatic Post Editing Shared Task.
HI-CMLM: Improve CMLM with Hybrid Decoder Input
Mask-predict CMLM (Ghazvininejad et al., 2019) has achieved stunning performance among non-autoregressive NMT models, but we find that the mechanism of predicting all of the target words only depending on the hidden state of [MASK] is not effective and efficient in initial iterations of refinement, resulting in ungrammatical repetitions and slow convergence.
The HW-TSC’s Speech to Speech Translation System for IWSLT 2022 Evaluation
The paper presents the HW-TSC’s pipeline and results of Offline Speech to Speech Translation for IWSLT 2022.
The HW-TSC’s Offline Speech Translation System for IWSLT 2022 Evaluation
For machine translation part, we pretrained three translation models on WMT21 dataset and fine-tuned them on in-domain corpora.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+4
Capture Human Disagreement Distributions by Calibrated Networks for Natural Language Inference
Natural Language Inference (NLI) datasets contain examples with highly ambiguous labels due to its subjectivity.
HW-TSC’s Participation at WMT 2020 Quality Estimation Shared Task
This paper presents our work in the WMT 2020 Word and Sentence-Level Post-Editing Quality Estimation (QE) Shared Task.
How Length Prediction Influence the Performance of Non-Autoregressive Translation?
Length prediction is a special task in a series of NAT models where target length has to be determined before generation.
Efficient Multi-modal Large Language Models via Visual Token Grouping
The development of Multi-modal Large Language Models (MLLMs) enhances Large Language Models (LLMs) with the ability to perceive data formats beyond text, significantly advancing a range of downstream applications, such as visual question answering and image captioning.
From Handcrafted Features to LLMs: A Brief Survey for Machine Translation Quality Estimation
Machine Translation Quality Estimation (MTQE) is the task of estimating the quality of machine-translated text in real time without the need for reference translations, which is of great importance for the development of MT.
Explore and Exploit the Diverse Knowledge in Model Zoo for Domain Generalization
The proliferation of pretrained models, as a result of advancements in pretraining techniques, has led to the emergence of a vast zoo of publicly available models.
PEMP: Leveraging Physics Properties to Enhance Molecular Property Prediction
In our implementation, we adopt both the state-of-the-art molecule embedding models under the supervised learning paradigm and the pretraining paradigm as the molecule representation module of PEMP, respectively.
When Does Group Invariant Learning Survive Spurious Correlations?
Motivated by this, we design a new group invariant learning method, which constructs groups with statistical independence tests, and reweights samples by group label proportion to meet the criteria.
Diformer: Directional Transformer for Neural Machine Translation
In this paper, we aim to close the gap by preserving the original objective of AR and NAR under a unified framework.
Self-Distillation Mixup Training for Non-autoregressive Neural Machine Translation
An effective training strategy to improve the performance of AT models is Self-Distillation Mixup (SDM) Training, which pre-trains a model on raw data, generates distilled data by the pre-trained model itself and finally re-trains a model on the combination of raw data and distilled data.
Joint-training on Symbiosis Networks for Deep Nueral Machine Translation models
Deep encoders have been proven to be effective in improving neural machine translation (NMT) systems, but it reaches the upper bound of translation quality when the number of encoder layers exceeds 18.
Uncertainty Calibration for Ensemble-Based Debiasing Methods
Ensemble-based debiasing methods have been shown effective in mitigating the reliance of classifiers on specific dataset bias, by exploiting the output of a bias-only model to adjust the learning target.
