Search Results for author:
Found 48 papers, 8 papers with code
A Linguistic Annotation Framework to Study Interactions in Multilingual Healthcare Conversational Forums
In recent years, remote digital healthcare using online chats has gained momentum, especially in the Global South.
Language Patterns and Behaviour of the Peer Supporters in Multilingual Healthcare Conversational Forums
In this work, we conduct a quantitative linguistic analysis of the language usage patterns of multilingual peer supporters in two health-focused WhatsApp groups in Kenya comprising of youth living with HIV.
KAHANI: Culturally-Nuanced Visual Storytelling Pipeline for Non-Western Cultures
To evaluate the effectiveness of KAHANI, we conducted a comparative user study with ChatGPT-4 (with DALL-E3) in which participants from different regions of India compared the cultural relevance of stories generated by the two tools.
Towards Inducing Document-Level Abilities in Standard Multilingual Neural Machine Translation Models
Neural Machine Translation (NMT) models have traditionally used Sinusoidal Positional Embeddings (PEs), which often struggle to capture long-range dependencies and are less efficient for handling extended context or document-level translation tasks.
Cultural Conditioning or Placebo? On the Effectiveness of Socio-Demographic Prompting
We observe that all models except GPT-4 show significant variations in their responses on both kinds of datasets for both kinds of prompts, casting doubt on the robustness of the culturally-conditioned prompting as a method for eliciting cultural bias in models or as an alignment strategy.
Beyond Metrics: Evaluating LLMs' Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios
The deployment of Large Language Models (LLMs) in real-world applications presents both opportunities and challenges, particularly in multilingual and code-mixed communication settings.
Bridging the Gap: Dynamic Learning Strategies for Improving Multilingual Performance in LLMs
Second, we introduce a new hybrid approach that synergizes LLM Retrieval Augmented Generation (RAG) with multilingual embeddings and achieves improved multilingual task performance.
Akal Badi ya Bias: An Exploratory Study of Gender Bias in Hindi Language Technology
Existing research in measuring and mitigating gender bias predominantly centers on English, overlooking the intricate challenges posed by non-English languages and the Global South.
METAL: Towards Multilingual Meta-Evaluation
This dataset is created specifically to evaluate LLM-based evaluators, which we refer to as meta-evaluation (METAL).
DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures
Generative models are increasingly being used in various applications, such as text generation, commonsense reasoning, and question-answering.
MunTTS: A Text-to-Speech System for Mundari
We present MunTTS, an end-to-end text-to-speech (TTS) system specifically for Mundari, a low-resource Indian language of the Austo-Asiatic family.
MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks
We also perform a study on data contamination and find that several models are likely to be contaminated with multilingual evaluation benchmarks, necessitating approaches to detect and handle contamination while assessing the multilingual performance of LLMs.
''Fifty Shades of Bias'': Normative Ratings of Gender Bias in GPT Generated English Text
Next, we systematically analyze the variation of themes of gender biases in the observed ranking and show that identity-attack is most closely related to gender bias.
Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?
Large Language Models (LLMs) excel in various Natural Language Processing (NLP) tasks, yet their evaluation, particularly in languages beyond the top $20$, remains inadequate due to existing benchmarks and metrics limitations.
X-RiSAWOZ: High-Quality End-to-End Multilingual Dialogue Datasets and Few-shot Agents
We create a new multilingual benchmark, X-RiSAWOZ, by translating the Chinese RiSAWOZ to 4 languages: English, French, Hindi, Korean; and a code-mixed English-Hindi language.
Bridging the Language Gap: Dynamic Learning Strategies for Improving Multilingual Performance in LLMs
Large language models (LLMs) have revolutionized various domains but still struggle with non-Latin scripts and low-resource languages.
MEGA: Multilingual Evaluation of Generative AI
Most studies on generative LLMs have been restricted to English and it is unclear how capable these models are at understanding and generating text in other languages.
Learnings from Technological Interventions in a Low Resource Language: Enhancing Information Access in Gondi
The primary obstacle to developing technologies for low-resource languages is the lack of representative, usable data.
Too Brittle To Touch: Comparing the Stability of Quantization and Distillation Towards Developing Lightweight Low-Resource MT Models
Leveraging shared learning through Massively Multilingual Models, state-of-the-art machine translation models are often able to adapt to the paucity of data for low-resource languages.
Annotated Speech Corpus for Low Resource Indian Languages: Awadhi, Bhojpuri, Braj and Magahi
In this paper we discuss an in-progress work on the development of a speech corpus for four low-resource Indo-Aryan languages -- Awadhi, Bhojpuri, Braj and Magahi using the field methods of linguistic data collection.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Global Readiness of Language Technology for Healthcare: What would it Take to Combat the Next Pandemic?
The COVID-19 pandemic has brought out both the best and worst of language technology (LT).
Predicting the Performance of Multilingual NLP Models
Recent advancements in NLP have given us models like mBERT and XLMR that can serve over 100 languages.
Designing Language Technologies for Social Good: The Road not Taken
Development of speech and language technology for social good (LT4SG), especially those targeted at the welfare of marginalized communities and speakers of low-resource and under-served languages, has been a prominent theme of research within NLP, Speech, and the AI communities.
Multilingual and code-switching ASR challenges for low resource Indian languages
For this purpose, we provide a total of ~600 hours of transcribed speech data, comprising train and test sets, in these languages including two code-switched language pairs, Hindi-English and Bengali-English.
Crowdsourcing Speech Data for Low-Resource Languages from Low-Income Workers
Unfortunately, collecting labelled speech data in any language is an expensive and resource-intensive task.
Understanding Script-Mixing: A Case Study of Hindi-English Bilingual Twitter Users
Our analysis shows that both intra-sentential and inter-sentential script-mixing are present on Twitter and show different behavior in different contexts.
Learnings from Technological Interventions in a Low Resource Language: A Case-Study on Gondi
The primary obstacle to developing technologies for low-resource languages is the lack of usable data.
The State and Fate of Linguistic Diversity and Inclusion in the NLP World
Language technologies contribute to promoting multilingualism and linguistic diversity around the world.
Unsung Challenges of Building and Deploying Language Technologies for Low Resource Language Communities
In this paper, we examine and analyze the challenges associated with developing and introducing language technologies to low-resource language communities.
INMT: Interactive Neural Machine Translation Prediction
In this paper, we demonstrate an Interactive Machine Translation interface, that assists human translators with on-the-fly hints and suggestions.
Language Modeling for Code-Mixing: The Role of Linguistic Theory based Synthetic Data
Training language models for Code-mixed (CM) language is known to be a difficult problem because of lack of data compounded by the increased confusability due to the presence of more than one language.
Automatic Speech Recognition (ASR)
Language Identification
+4
Accommodation of Conversational Code-Choice
We find that the saliency or markedness of a language in context directly affects the degree of accommodation observed.
Phone Merging For Code-Switched Speech Recognition
Though the best performance gain of 1. 2{\%} WER was observed with manually merged phones, we show experimentally that the manual phone merge is not optimal.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Estimating Code-Switching on Twitter with a Novel Generalized Word-Level Language Detection Technique
Word-level language detection is necessary for analyzing code-switched text, where multiple languages could be mixed within a sentence.
Grammatical Constraints on Intra-sentential Code-Switching: From Theories to Working Models
We make one of the first attempts to build working models for intra-sentential code-switching based on the Equivalence-Constraint (Poplack 1980) and Matrix-Language (Myers-Scotton 1993) theories.
Functions of Code-Switching in Tweets: An Annotation Framework and Some Initial Experiments
Code-Switching (CS) between two languages is extremely common in communities with societal multilingualism where speakers switch between two or more languages when interacting with each other.
Mining Hindi-English Transliteration Pairs from Online Hindi Lyrics
This paper describes a method to mine Hindi-English transliteration pairs from online Hindi song lyrics.
