Search Results for author:
Found 9 papers, 0 papers with code
CALM: Contrastive Aligned Audio-Language Multirate and Multimodal Representations
By aligning audio representations to pretrained language representations and utilizing contrastive information between acoustic inputs, CALM is able to bootstrap audio embedding competitive with existing audio representation models in only a few hours of training time.
Streaming on-device detection of device directed speech from voice and touch-based invocation
When interacting with smart devices such as mobile phones or wearables, the user typically invokes a virtual assistant (VA) by saying a keyword or by pressing a button on the device.
Analysis and Tuning of a Voice Assistant System for Dysfluent Speech
Dysfluencies and variations in speech pronunciation can severely degrade speech recognition performance, and for many individuals with moderate-to-severe speech disorders, voice operated systems do not work.
SEP-28k: A Dataset for Stuttering Event Detection From Podcasts With People Who Stutter
The ability to automatically detect stuttering events in speech could help speech pathologists track an individual's fluency over time or help improve speech recognition systems for people with atypical speech patterns.
Knowledge Transfer for Efficient On-device False Trigger Mitigation
But in case of a false trigger, transcribing the audio using ASR itself is strongly undesirable.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Audiovisual Speech Synthesis using Tacotron2
The output acoustic features are used to condition a WaveRNN to reconstruct the speech waveform, and the output facial controllers are used to generate the corresponding video of the talking face.
On the Role of Visual Cues in Audiovisual Speech Enhancement
One byproduct of this finding is that the learned visual embeddings can be used as features for other visual speech applications.
Detecting Emotion Primitives from Speech and their use in discerning Categorical Emotions
Emotion plays an essential role in human-to-human communication, enabling us to convey feelings such as happiness, frustration, and sincerity.
Multi-task Learning for Speaker Verification and Voice Trigger Detection
We train the network in a supervised multi-task learning setup, where the speech transcription branch of the network is trained to minimise a phonetic connectionist temporal classification (CTC) loss while the speaker recognition branch of the network is trained to label the input sequence with the correct label for the speaker.
