Search Results for author: Xingyu Cai

Found 14 papers, 2 papers with code

Improving Bilingual Lexicon Induction for Low Frequency Words

no code implementations EMNLP 2020 Jiaji Huang, Xingyu Cai, Kenneth Church

This paper designs a Monolingual Lexicon Induction task and observes that two factors accompany the degraded accuracy of bilingual lexicon induction for rare words.

Bilingual Lexicon Induction

Training on Lexical Resources

1 code implementation LREC 2022 Kenneth Church, Xingyu Cai, Yuchen Bian

We propose using lexical resources (thesaurus, VAD) to fine-tune pretrained deep nets such as BERT and ERNIE.

Massive End-to-end Models for Short Search Queries

no code implementations22 Sep 2023 Weiran Wang, Rohit Prabhavalkar, Dongseong Hwang, Qiujia Li, Khe Chai Sim, Bo Li, James Qin, Xingyu Cai, Adam Stooke, Zhong Meng, CJ Zheng, Yanzhang He, Tara Sainath, Pedro Moreno Mengibar

In this work, we investigate two popular end-to-end automatic speech recognition (ASR) models, namely Connectionist Temporal Classification (CTC) and RNN-Transducer (RNN-T), for offline recognition of voice search queries, with up to 2B model parameters.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +1

Data-Driven Adaptive Simultaneous Machine Translation

no code implementations27 Apr 2022 Guangxu Xun, Mingbo Ma, Yuchen Bian, Xingyu Cai, Jiaji Huang, Renjie Zheng, Junkun Chen, Jiahong Yuan, Kenneth Church, Liang Huang

In simultaneous translation (SimulMT), the most widely used strategy is the wait-k policy thanks to its simplicity and effectiveness in balancing translation quality and latency.

Machine Translation Sentence +1

Automatic recognition of suprasegmentals in speech

no code implementations2 Aug 2021 Jiahong Yuan, Neville Ryant, Xingyu Cai, Kenneth Church, Mark Liberman

This study reports our efforts to improve automatic recognition of suprasegmentals by fine-tuning wav2vec 2. 0 with CTC, a method that has been successful in automatic speech recognition.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +1

The Role of Phonetic Units in Speech Emotion Recognition

no code implementations2 Aug 2021 Jiahong Yuan, Xingyu Cai, Renjie Zheng, Liang Huang, Kenneth Church

Models of phonemes, broad phonetic classes, and syllables all significantly outperform the utterance model, demonstrating that phonetic units are helpful and should be incorporated in speech emotion recognition.

Speech Emotion Recognition speech-recognition +1

On Attention Redundancy: A Comprehensive Study

no code implementations NAACL 2021 Yuchen Bian, Jiaji Huang, Xingyu Cai, Jiahong Yuan, Kenneth Church

(What) We define and focus the study on redundancy matrices generated from pre-trained and fine-tuned BERT-base model for GLUE datasets.

Model Compression Sentence

Better than BERT but Worse than Baseline

no code implementations12 May 2021 Boxiang Liu, Jiaji Huang, Xingyu Cai, Kenneth Church

This paper compares BERT-SQuAD and Ab3P on the Abbreviation Definition Identification (ADI) task.

Isotropy in the Contextual Embedding Space: Clusters and Manifolds

no code implementations ICLR 2021 Xingyu Cai, Jiaji Huang, Yuchen Bian, Kenneth Church

We hope the study in this paper could provide insights towards a better understanding of the deep language models.

Cannot find the paper you are looking for? You can Submit a new open access paper.