Is Robustness Transferable across Languages in Multilingual Neural Machine Translation?

no code implementations • 31 Oct 2023 • Leiyu Pan, Supryadi, Deyi Xiong

In particular, we use character-, word-, and multi-level noises to attack the specific translation direction of the multilingual neural machine translation model and evaluate the robustness of other translation directions.

Data Augmentation Machine Translation +1

Evaluating Large Language Models: A Comprehensive Survey

1 code implementation • 30 Oct 2023 • Zishan Guo, Renren Jin, Chuang Liu, Yufei Huang, Dan Shi, Supryadi, Linhao Yu, Yan Liu, Jiaxuan Li, Bojian Xiong, Deyi Xiong

We hope that this comprehensive overview will stimulate further research interests in the evaluation of LLMs, with the ultimate goal of making evaluation serve as a cornerstone in guiding the responsible development of LLMs.