Search Results for author:
Found 6 papers, 1 papers with code
A Closer Look at Audio-Visual Multi-Person Speech Recognition and Active Speaker Selection
As an alternative, recent work has proposed to address the two problems simultaneously with an attention mechanism, baking the speaker selection problem directly into a fully differentiable model.
End-to-End Multi-Person Audio/Visual Automatic Speech Recognition
Traditionally, audio-visual automatic speech recognition has been studied under the assumption that the speaking face on the visual signal is the face matching the audio.
Best of Both Worlds: Multi-task Audio-Visual Automatic Speech Recognition and Active Speaker Detection
Under noisy conditions, automatic speech recognition (ASR) can greatly benefit from the addition of visual signals coming from a video of the speaker's face.
Transformer-Based Video Front-Ends for Audio-Visual Speech Recognition
In this work, we propose to replace the 3D convolution with a video transformer video feature extractor.
Audio-Visual Speech Recognition
Automatic Speech Recognition
+2
Audio-Visual Speech Recognition is Worth 32$\times$32$\times$8 Voxels
In this work, we propose to replace the 3D convolutional visual front-end with a video transformer front-end.
Audio-Visual Speech Recognition
Automatic Speech Recognition
+3
Recurrent Neural Network Transducer for Audio-Visual Speech Recognition
This work presents a large-scale audio-visual speech recognition system based on a recurrent neural network transducer (RNN-T) architecture.
Ranked #3 on
Audio-Visual Speech Recognition
on LRS3-TED
