no code implementations • 22 Mar 2023 • Samik Sadhu, Hynek Hermansky
We show that training a multi-headed self-attention-based deep network to predict deleted, information-dense 2-8 Hz speech modulations over a 1. 5-second section of a speech utterance is an effective way to make machines learn to extract speech modulations using time-domain contextual information.
no code implementations • 7 Mar 2023 • Martin Sustek, Samik Sadhu, Lukas Burget, Hynek Hermansky, Jesus Villalba, Laureano Moro-Velazquez, Najim Dehak
The JEM training relies on "positive examples" (i. e. examples from the training data set) as well as on "negative examples", which are samples from the modeled distribution $p(x)$ generated by means of Stochastic Gradient Langevin Dynamics (SGLD).
no code implementations • 30 Sep 2022 • Samik Sadhu, Hynek Hermansky
We present a method to remove unknown convolutive noise introduced to speech by reverberations of recording environments, utilizing some amount of training speech data from the reverberant environment, and any available non-reverberant speech data.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
no code implementations • 31 Mar 2022 • Samik Sadhu, Hynek Hermansky
How important are different temporal speech modulations for speech recognition?
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
2 code implementations • 25 Mar 2021 • Samik Sadhu, Hynek Hermansky
We propose a technique to compute spectrograms using Frequency Domain Linear Prediction (FDLP) that uses all-pole models to fit the squared Hilbert envelope of speech in different frequency sub-bands.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
no code implementations • 9 Mar 2021 • Samik Sadhu, Di He, Che-Wei Huang, Sri Harish Mallidi, Minhua Wu, Ariya Rastrow, Andreas Stolcke, Jasha Droppo, Roland Maas
However, the quantization process is regularized by an additional consistency network that learns to reconstruct the input features to the wav2vec 2. 0 network from the quantized representations in a way similar to a VQ-VAE model.
no code implementations • 8 Apr 2019 • Xiaofei Wang, Jinyi Yang, Ruizhi Li, Samik Sadhu, Hynek Hermansky
Quality of data plays an important role in most deep learning tasks.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2