no code implementations • 18 Feb 2025 • Jarod Lévy, Mingfang Zhang, Svetlana Pinet, Jérémy Rapin, Hubert Banville, Stéphane d'Ascoli, Jean-Rémi King
For this, we present Brain2Qwerty, a new deep learning architecture trained to decode sentences from either electro- (EEG) or magneto-encephalography (MEG), while participants typed briefly memorized sentences on a QWERTY keyboard.
no code implementations • 11 Feb 2025 • Mingfang Zhang, Jarod Lévy, Stéphane d'Ascoli, Jérémy Rapin, F. -Xavier Alario, Pierre Bourdillon, Svetlana Pinet, Jean-Rémi King
This approach confirms the hierarchical predictions of linguistic theories: the neural activity preceding the production of each word is marked by the sequential rise and fall of context-, word-, syllable-, and letter-level representations.
no code implementations • 25 Jan 2025 • Hubert Banville, Yohann Benchetrit, Stéphane d'Ascoli, Jérémy Rapin, Jean-Rémi King
Overall, these findings delineate the path most suitable to scale the decoding of images from non-invasive brain recordings.
no code implementations • 11 Dec 2024 • Stéphane d'Ascoli, Corentin Bel, Jérémy Rapin, Hubert Banville, Yohann Benchetrit, Christophe Pallier, Jean-Rémi King
To tackle this issue, we introduce a novel deep learning pipeline to decode individual words from non-invasive electro- (EEG) and magneto-encephalography (MEG) signals.
no code implementations • 7 Dec 2024 • Pablo Diego-Simón, Stéphane d'Ascoli, Emmanuel Chemla, Yair Lakretz, Jean-Rémi King
However, this syntactic code remains incomplete: the distance between the Structural Probe word embeddings can represent the existence but not the type and direction of syntactic relations.
no code implementations • 11 Dec 2023 • Alexis Thual, Yohann Benchetrit, Felix Geilert, Jérémy Rapin, Iurii Makarov, Hubert Banville, Jean-Rémi King
Deep learning is leading to major advances in the realm of brain decoding from functional Magnetic Resonance Imaging (fMRI).
no code implementations • 18 Oct 2023 • Yohann Benchetrit, Hubert Banville, Jean-Rémi King
In the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity.
no code implementations • 6 Jun 2023 • Linnea Evanson, Yair Lakretz, Jean-Rémi King
To investigate this, we here compare the learning trajectories of deep language models to those of children.
1 code implementation • 25 Aug 2022 • Alexandre Défossez, Charlotte Caucheteux, Jérémy Rapin, Ori Kabeli, Jean-Rémi King
Overall, this effective decoding of perceived speech from non-invasive recordings delineates a promising path to decode language from brain activity, without putting patients at risk for brain surgery.
no code implementations • 15 Feb 2022 • Pierre Orhan, Yves Boubenec, Jean-Rémi King
Over the last decade, numerous studies have shown that deep neural networks exhibit sensory representations similar to those of the mammalian brain, in that their activations linearly map onto cortical responses to the same sensory inputs.
no code implementations • Findings (EMNLP) 2021 • Charlotte Caucheteux, Alexandre Gramfort, Jean-Rémi King
A popular approach to decompose the neural bases of language consists in correlating, across individuals, the brain responses to different stimuli (e. g. regular speech versus scrambled words, sentences, or paragraphs).
no code implementations • 6 Jan 2021 • Yair Lakretz, Théo Desbordes, Jean-Rémi King, Benoît Crabbé, Maxime Oquab, Stanislas Dehaene
Finally, probing the internal states of the model during the processing of sentences with nested tree structures, we found a complex encoding of grammatical agreement information (e. g. grammatical number), in which all the information for multiple words nouns was carried by a single unit.