Search Results for author:
Found 9 papers, 5 papers with code
TransliCo: A Contrastive Learning Framework to Address the Script Barrier in Multilingual Pretrained Language Models
As a result, mPLMs present a script barrier: representations from different scripts are located in different subspaces, which is a strong indicator of why crosslingual transfer involving languages of different scripts shows sub-optimal performance.
MoSECroT: Model Stitching with Static Word Embeddings for Crosslingual Zero-shot Transfer
In this paper, we introduce MoSECroT Model Stitching with Static Word Embeddings for Crosslingual Zero-shot Transfer), a novel and challenging task that is especially relevant to low-resource languages for which static word embeddings are available.
OFA: A Framework of Initializing Unseen Subword Embeddings for Efficient Large-scale Multilingual Continued Pretraining
Instead of pretraining multilingual language models from scratch, a more efficient method is to adapt existing pretrained language models (PLMs) to new languages via vocabulary extension and continued pretraining.
On the Copying Problem of Unsupervised NMT: A Training Schedule with a Language Discriminator Loss
By conducting extensive experiments on different language pairs, including similar and distant, high and low-resource languages, we find that our method alleviates the copying problem, thus improving the translation performance on low-resource languages.
A study of conceptual language similarity: comparison and evaluation
An interesting line of research in natural language processing (NLP) aims to incorporate linguistic typology to bridge linguistic diversity and assist the research of low-resource languages.
Crosslingual Transfer Learning for Low-Resource Languages Based on Multilingual Colexification Graphs
ColexNet's nodes are concepts and its edges are colexifications.
A Crosslingual Investigation of Conceptualization in 1335 Languages
The resulting measure for the conceptual similarity of two languages is complementary to standard genealogical, typological, and surface similarity measures.
Flow-Adapter Architecture for Unsupervised Machine Translation
The primary novelties of our model are: (a) capturing language-specific sentence representations separately for each language using normalizing flows and (b) using a simple transformation of these latent representations for translating from one language to another.
Reconfigurable Intelligent Surface-induced Randomness for mmWave Key Generation
In this paper, for mmWave secret key generation of physical layer security, we use a reconfigurable intelligent surface (RIS) to induce randomness directly in wireless environments, without adding complexity to transceivers.
