Search Results for author:
Found 10 papers, 0 papers with code
SpiRit-LM: Interleaved Spoken and Written Language Model
We introduce SPIRIT-LM, a foundation multimodal language model that freely mixes text and speech.
XLS-R fine-tuning on noisy word boundaries for unsupervised speech segmentation into words
Due to the absence of explicit word boundaries in the speech stream, the task of segmenting spoken sentences into word units without text supervision is particularly challenging.
Generative Spoken Language Model based on continuous word-sized audio tokens
In NLP, text language models based on words or subwords are known to outperform their character-based counterparts.
Speech Sequence Embeddings using Nearest Neighbors Contrastive Learning
We introduce a simple neural encoder architecture that can be trained using an unsupervised contrastive learning objective which gets its positive samples from data-augmented k-Nearest Neighbors search.
Generative Spoken Dialogue Language Modeling
We introduce dGSLM, the first "textless" model able to generate audio samples of naturalistic spoken dialogues.
Are discrete units necessary for Spoken Language Modeling?
The approach relies first on transforming the audio into a sequence of discrete units (or pseudo-text) and then training a language model directly on such pseudo-text.
Evaluating the reliability of acoustic speech embeddings
However, there is currently no clear methodology to compare or optimise the quality of these embeddings in a task-neutral way.
Can Multilingual Language Models Transfer to an Unseen Dialect? A Case Study on North African Arabizi
Building natural language processing systems for non standardized and low resource languages is a difficult challenge.
Enhancing BERT for Lexical Normalization
In this article, focusing on User Generated Content (UGC), we study the ability of BERT to perform lexical normalisation.
