A Cross-Modal Approach to Silent Speech with LLM-Enhanced Recognition

1 code implementation • 2 Mar 2024 • Tyler Benster, Guy Wilson, Reshef Elisha, Francis R Willett, Shaul Druckmann

To the best of our knowledge, this work represents the first instance where noninvasive silent speech recognition on an open vocabulary has cleared the threshold of 15% WER, demonstrating that SSIs can be a viable alternative to automatic speech recognition (ASR).

Automatic Speech Recognition Automatic Speech Recognition (ASR) +3