PESTO: Switching Point based Dynamic and Relative Positional Encoding for Code-Mixed Languages

1 code implementation • 12 Nov 2021 • Mohsin Ali, Kandukuri Sai Teja, Sumanth Manduru, Parth Patwa, Amitava Das

NLP applications for code-mixed (CM) or mix-lingual text have gained a significant momentum recently, the main reason being the prevalence of language mixing in social media communications in multi-lingual societies like India, Mexico, Europe, parts of USA etc.

Position Word Embeddings