no code implementations • RepL4NLP (ACL) 2022 • Evgeniia Tokarchuk, Vlad Niculae
We explore pretrained embeddings and also introduce knowledge transfer from the discrete Transformer model using embeddings in Euclidean and non-Euclidean spaces.
no code implementations • 31 Oct 2023 • Evgeniia Tokarchuk, Vlad Niculae
Continuous-output neural machine translation (CoNMT) replaces the discrete next-word prediction problem with an embedding prediction.
no code implementations • ACL 2021 • Evgeniia Tokarchuk, David Thulke, Weiyue Wang, Christian Dugast, Hermann Ney
Data processing is an important step in various natural language processing tasks.
no code implementations • 27 Sep 2021 • Evgeniia Tokarchuk, Jan Rosendahl, Weiyue Wang, Pavel Petrushkov, Tomer Lancewicki, Shahram Khadivi, Hermann Ney
Pivot-based neural machine translation (NMT) is commonly used in low-resource setups, especially for translation between non-English language pairs.
no code implementations • ACL (IWSLT) 2021 • Evgeniia Tokarchuk, Jan Rosendahl, Weiyue Wang, Pavel Petrushkov, Tomer Lancewicki, Shahram Khadivi, Hermann Ney
Complex natural language applications such as speech translation or pivot translation traditionally rely on cascaded models.