Search Results for author: Santiago Cuervo

Found 7 papers, 2 papers with code

Transfer Learning from Whisper for Microscopic Intelligibility Prediction

no code implementations2 Apr 2024 Paul Best, Santiago Cuervo, Ricard Marxer

Macroscopic intelligibility models predict the expected human word-error-rate for a given speech-in-noise stimulus.

Automatic Speech Recognition speech-recognition +2

Scaling Properties of Speech Language Models

no code implementations31 Mar 2024 Santiago Cuervo, Ricard Marxer

We establish a strong correlation between pre-training loss and downstream syntactic and semantic performance in SLMs and LLMs, which results in predictable scaling of linguistic performance.

Speech foundation models on intelligibility prediction for hearing-impaired listeners

no code implementations24 Jan 2024 Santiago Cuervo, Ricard Marxer

Our method resulted in the winning submission in the CPC2, demonstrating its promise for speech perception applications.

Variable-rate hierarchical CPC leads to acoustic unit discovery in speech

1 code implementation5 Jun 2022 Santiago Cuervo, Adrian Łańcucki, Ricard Marxer, Paweł Rychlikowski, Jan Chorowski

The success of deep learning comes from its ability to capture the hierarchical structure of data by learning high-level representations defined in terms of low-level ones.

Acoustic Unit Discovery Disentanglement +4

Contrastive prediction strategies for unsupervised segmentation and categorization of phonemes and words

1 code implementation29 Oct 2021 Santiago Cuervo, Maciej Grabias, Jan Chorowski, Grzegorz Ciesielski, Adrian Łańcucki, Paweł Rychlikowski, Ricard Marxer

We investigate the performance on phoneme categorization and phoneme and word segmentation of several self-supervised learning (SSL) methods based on Contrastive Predictive Coding (CPC).

Segmentation Self-Supervised Learning

Emergent cooperation through mutual information maximization

no code implementations21 Jun 2020 Santiago Cuervo, Marco Alzate

The algorithm is based on the hypothesis that highly correlated actions are a feature of cooperative systems, and hence, we propose the insertion of an auxiliary objective of maximization of the mutual information between the actions of agents in the learning problem.

Cannot find the paper you are looking for? You can Submit a new open access paper.