A Cross-Modal Approach to Silent Speech with LLM-Enhanced Recognition

1 code implementation • 2 Mar 2024 • Tyler Benster, Guy Wilson, Reshef Elisha, Francis R Willett, Shaul Druckmann

To the best of our knowledge, this work represents the first instance where noninvasive silent speech recognition on an open vocabulary has cleared the threshold of 15% WER, demonstrating that SSIs can be a viable alternative to automatic speech recognition (ASR).

Automatic Speech Recognition Automatic Speech Recognition (ASR) +3

Avoiding Spurious Local Minima in Deep Quadratic Networks

1 code implementation • 31 Dec 2019 • Abbas Kazemipour, Brett W. Larsen, Shaul Druckmann

Despite their practical success, a theoretical understanding of the loss landscape of neural networks has proven challenging due to the high-dimensional, non-convex, and highly nonlinear structure of such models.

A mechanistic model of early sensory processing based on subtracting sparse representations

no code implementations • NeurIPS 2012 • Shaul Druckmann, Tao Hu, Dmitri B. Chklovskii

However, feedback inhibitory circuits are common in early sensory circuits and furthermore their dynamics may be nonlinear.

Over-complete representations on recurrent neural networks can support persistent percepts

no code implementations • NeurIPS 2010 • Shaul Druckmann, Dmitri B. Chklovskii

A striking aspect of cortical neural networks is the divergence of a relatively small number of input channels from the peripheral sensory apparatus into a large number of cortical neurons, an over-complete representation strategy.