Search Results for author:
Found 70 papers, 33 papers with code
Preserving Cross-Linguality of Pre-trained Models via Continual Learning
Recently, fine-tuning pre-trained language models (e. g., multilingual BERT) to downstream cross-lingual tasks has shown promising results.
CAiRE in DialDoc21: Data Augmentation for Information Seeking Dialogue System
Information-seeking dialogue systems, including knowledge identification and response generation, aim to respond to users with fluent, coherent, and informative responses based on users’ needs, which.
NusaWrites: Constructing High-Quality Corpora for Underrepresented and Extremely Low-Resource Languages
We compare the effectiveness of online scraping, human translation, and paragraph writing by native speakers in constructing datasets.
Multilingual Few-Shot Learning via Language Model Retrieval
Transformer-based language models have achieved remarkable success in few-shot in-context learning and drawn a lot of research interest.
On "Scientific Debt" in NLP: A Case for More Rigour in Language Model Pre-Training Research
This evidence-based position paper critiques current research practices within the language model pre-training literature.
Overcoming Catastrophic Forgetting in Massively Multilingual Continual Learning
Real-life multilingual systems should be able to efficiently incorporate new languages as data distributions fed to the system evolve and shift over time.
Multi-lingual and Multi-cultural Figurative Language Understanding
Figurative language permeates human communication, but at the same time is relatively understudied in NLP.
GlobalBench: A Benchmark for Global Progress in Natural Language Processing
Despite the major advances in NLP, significant disparities in NLP system performance across languages still exist.
Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languages
While code-mixing is a common linguistic practice in many parts of the world, collecting high-quality and low-cost code-mixed data remains a challenge for natural language processing (NLP) research.
The Decades Progress on Code-Switching Research in NLP: A Systematic Survey on Trends and Challenges
Code-Switching, a common phenomenon in written text and conversation, has been studied over decades by the natural language processing (NLP) research community.
BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting
We find language adaptation to be effective at improving zero-shot performance in new languages.
NusaCrowd: Open Source Initiative for Indonesian NLP Resources
We present NusaCrowd, a collaborative initiative to collect and unify existing resources for Indonesian languages, including opening access to previously non-public resources.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions.
Transfer Learning Application of Self-supervised Learning in ARPES
Recent development in angle-resolved photoemission spectroscopy (ARPES) technique involves spatially resolving samples while maintaining the high-resolution feature of momentum space.
NusaCrowd: A Call for Open and Reproducible NLP Research in Indonesian Languages
At the center of the underlying issues that halt Indonesian natural language processing (NLP) research advancement, we find data scarcity.
GEMv2: Multilingual NLG Benchmarking in a Single Line of Code
This problem is especially pertinent in natural language generation which requires ever-improving suites of datasets, metrics, and human evaluation to make definitive claims.
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
BIG-bench focuses on tasks that are believed to be beyond the capabilities of current language models.
NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages
In this work, we focus on developing resources for languages in Indonesia.
One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia
NLP research is impeded by a lack of resources and awareness of the challenges presented by underrepresented languages and dialects.
A Comparative Study on Language Models for Task-Oriented Dialogue Systems
The recent development of language models has shown promising results by achieving state-of-the-art performance on various natural language tasks by fine-tuning pretrained models.
CI-AVSR: A Cantonese Audio-Visual Speech Dataset for In-car Command Recognition
With the rise of deep learning and intelligent vehicle, the smart assistant has become an essential in-car component to facilitate driving and provide extra functionalities.
ASCEND: A Spontaneous Chinese-English Dataset for Code-switching in Multi-turn Conversation
ASCEND (A Spontaneous Chinese-English Dataset) is a high-quality Mandarin Chinese-English code-switching corpus built on spontaneous multi-turn conversational dialogue sources collected in Hong Kong.
NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation
Data augmentation is an important component in the robustness evaluation of models in natural language processing (NLP) and in enhancing the diversity of the data they are trained on.
Few-Shot Bot: Prompt-Based Learning for Dialogue Systems
A simple yet unexplored solution is prompt-based few-shot learning (Brown et al. 2020) which does not require gradient-based fine-tuning but instead uses a few examples in the LM context as the only source of learning.
Language Models are Few-shot Multilingual Learners
General-purpose language models have demonstrated impressive capabilities, performing on par with state-of-the-art approaches on a range of downstream natural language processing (NLP) tasks and benchmarks when inferring instructions from very few examples.
Greenformer: Factorization Toolkit for Efficient Deep Neural Networks
While the recent advances in deep neural networks (DNN) bring remarkable success, the computational cost also increases considerably.
X2Parser: Cross-Lingual and Cross-Domain Framework for Task-Oriented Compositional Semantic Parsing
Experimental results illustrate that our model can significantly outperform existing strong baselines in cross-lingual and cross-domain settings, and our model can also achieve a good generalization ability on target languages of target domains.
CAiRE in DialDoc21: Data Augmentation for Information-Seeking Dialogue System
Information-seeking dialogue systems, including knowledge identification and response generation, aim to respond to users with fluent, coherent, and informative responses based on users' needs, which.
BiToD: A Bilingual Multi-Domain Dataset For Task-Oriented Dialogue Modeling
However, existing datasets for end-to-end ToD modeling are limited to a single language, hindering the development of robust end-to-end ToD systems for multilingual countries and regions.
ERICA: An Empathetic Android Companion for Covid-19 Quarantine
Over the past year, research in various domains, including Natural Language Processing (NLP), has been accelerated to fight against the COVID-19 pandemic, yet such research has just started on dialogue systems.
Nora: The Well-Being Coach
The current pandemic has forced people globally to remain in isolation and practice social distancing, which creates the need for a system to combat the resulting loneliness and negative emotions.
Retrieval-Free Knowledge-Grounded Dialogue Response Generation with Adapters
This paper proposes KnowExpert, a framework to bypass the explicit retrieval process and inject knowledge into the pre-trained language models with lightweight adapters and adapt to the knowledge-grounded dialogue task.
Continual Mixed-Language Pre-Training for Extremely Low-Resource Neural Machine Translation
The data scarcity in low-resource languages has become a bottleneck to building robust neural machine translation systems.
IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation
Natural language generation (NLG) benchmarks provide an important avenue to measure progress and develop better NLG systems.
Multilingual Transfer Learning for Code-Switched Language and Speech Neural Modeling
More importantly, the model can be effectively used for languages that are syntactically different, and it outperforms the linguistic theory-based models.
Are Multilingual Models Effective in Code-Switching?
Multilingual language models have shown decent performance in multilingual and cross-lingual natural language understanding tasks.
Adapt-and-Adjust: Overcoming the Long-Tail Problem of Multilingual Speech Recognition
One crucial challenge of real-world multilingual speech recognition is the long-tailed distribution problem, where some resource-rich languages like English have abundant training data, but a long tail of low-resource languages have varying amounts of limited training data.
Cross-lingual Spoken Language Understanding with Regularized Representation Alignment
Despite the promising results of current cross-lingual models for spoken language understanding systems, they still suffer from imperfect cross-lingual representation alignments between the source and target languages, which makes the performance sub-optimal.
Learning Knowledge Bases with Parameters for Task-Oriented Dialogue Systems
In this paper, we propose a method to embed the KB, of any size, directly into the model parameters.
MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems
In this paper, we propose Minimalist Transfer Learning (MinTL) to simplify the system design process of task-oriented dialogue systems and alleviate the over-dependency on annotated data.
Ranked #15 on
Multi-domain Dialogue State Tracking
on MULTIWOZ 2.1
Dialogue State Tracking
Multi-domain Dialogue State Tracking
+3
IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding
Although Indonesian is known to be the fourth most frequently used language over the internet, the research progress on this language in the natural language processing (NLP) is slow-moving due to a lack of available resources.
EmoGraph: Capturing Emotion Correlations using Graph Networks
Most emotion recognition methods tackle the emotion understanding task by considering individual emotion independently while ignoring their fuzziness nature and the interconnections among them.
Ranked #3 on
Emotion Classification
on SemEval 2018 Task 1E-c
Meta-Transfer Learning for Code-Switched Speech Recognition
An increasing number of people in the world today speak a mixed-language as a result of being multilingual.
Exploring Fine-tuning Techniques for Pre-trained Cross-lingual Models via Continual Learning
Recently, fine-tuning pre-trained language models (e. g., multilingual BERT) to downstream cross-lingual tasks has shown promising results.
Coach: A Coarse-to-Fine Approach for Cross-domain Slot Filling
In this paper, we propose a Coarse-to-fine approach (Coach) for cross-domain slot filling.
Cross-Domain Named Entity Recognition
named-entity-recognition
+3
Variational Transformers for Diverse Response Generation
Despite the great promise of Transformers in many sequence modeling tasks (e. g., machine translation), their deterministic nature hinders them from generalizing to high entropy tasks such as dialogue response generation.
XPersona: Evaluating Multilingual Personalized Chatbot
Experimental results show that the multilingual trained models outperform the translation-pipeline and that they are on par with the monolingual models, with the advantage of having a single model across multiple languages.
Learning Fast Adaptation on Cross-Accented Speech Recognition
The great variability and complex characteristics of accents creates a major challenge for training a robust and accent-agnostic automatic speech recognition (ASR) system.
Audio and Speech Processing Sound
Zero-Resource Cross-Domain Named Entity Recognition
Existing models for cross-domain named entity recognition (NER) rely on numerous unlabeled corpus or labeled NER training data in target domains.
Ranked #1 on
Cross-Domain Named Entity Recognition
on CoNLL04
On the Importance of Word Order Information in Cross-lingual Sequence Labeling
To verify this hypothesis, we investigate whether making models insensitive to the word order of the source language can improve the adaptation performance in target languages.
Attention-Informed Mixed-Language Training for Zero-shot Cross-lingual Task-oriented Dialogue Systems
Recently, data-driven task-oriented dialogue systems have achieved promising performance in English.
Zero-shot Cross-lingual Dialogue Systems with Transferable Latent Variables
Despite the surging demands for multilingual task-oriented dialog systems (e. g., Alexa, Google Home), there has been less research done in multilingual or cross-lingual scenarios.
Generalizing Question Answering System with Pre-trained Language Model Fine-tuning
With a large number of datasets being released and new techniques being proposed, Question answering (QA) systems have witnessed great breakthroughs in reading comprehension (RC)tasks.
Lightweight and Efficient End-to-End Speech Recognition Using Low-Rank Transformer
Highly performing deep neural networks come at the cost of computational complexity that limits their practicality for deployment on portable devices.
Hierarchical Meta-Embeddings for Code-Switching Named Entity Recognition
In countries that speak multiple main languages, mixing up different languages within a conversation is commonly called code-switching.
Code-Switched Language Models Using Neural Based Synthetic Data from Parallel Sentences
Training code-switched language models is difficult due to lack of data and complexity in the grammatical structure.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
On the Effectiveness of Low-Rank Matrix Factorization for LSTM Model Compression
Despite their ubiquity in NLP tasks, Long Short-Term Memory (LSTM) networks suffer from computational inefficiencies caused by inherent unparallelizable recurrences, which further aggravates as LSTMs require more parameters for larger memory capacity.
Incorporating Word and Subword Units in Unsupervised Machine Translation Using Language Model Rescoring
This paper describes CAiRE's submission to the unsupervised machine translation track of the WMT'19 news shared task from German to Czech.
Learning Multilingual Meta-Embeddings for Code-Switching Named Entity Recognition
In this paper, we propose Multilingual Meta-Embeddings (MME), an effective method to learn multilingual representations by leveraging monolingual pre-trained embeddings.
CAiRE: An Empathetic Neural Chatbot
In this paper, we present an end-to-end empathetic conversation agent CAiRE.
CAiRE_HKUST at SemEval-2019 Task 3: Hierarchical Attention for Dialogue Emotion Classification
Detecting emotion from dialogue is a challenge that has not yet been extensively surveyed.
CAiRE\_HKUST at SemEval-2019 Task 3: Hierarchical Attention for Dialogue Emotion Classification
Detecting emotion from dialogue is a challenge that has not yet been extensively surveyed.
Towards End-to-end Automatic Code-Switching Speech Recognition
Speech recognition in mixed language has difficulties to adapt end-to-end framework due to the lack of data and overlapping phone sets, for example in words such as "one" in English and "w\`an" in Chinese.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Learning Comment Generation by Leveraging User-Generated Data
Existing models on open-domain comment generation are difficult to train, and they produce repetitive and uninteresting responses.
Handling Imbalanced Dataset in Multi-label Text Categorization using Bagging and Adaptive Boosting
The result is evaluated with four evaluation metrics such as hamming loss, subset accuracy, example-based accuracy and micro-averaged f-measure.
Learn to Code-Switch: Data Augmentation using Copy Mechanism on Language Modeling
Building large-scale datasets for training code-switching language models is challenging and very expensive.
Attention-Based LSTM for Psychological Stress Detection from Spoken Language Using Distant Supervision
The bidirectional LSTM model with attention is found to be the best model in terms of accuracy (74. 1%) and f-score (74. 3%).
Code-Switching Language Modeling using Syntax-Aware Multi-Task Learning
Lack of text data has been the major issue on code-switching language modeling.
Bilingual Character Representation for Efficiently Addressing Out-of-Vocabulary Words in Code-Switching Named Entity Recognition
We propose an LSTM-based model with hierarchical architecture on named entity recognition from code-switching Twitter data.
