no code implementations • 26 Mar 2024 • Linyang He, Peili Chen, Ercong Nie, Yuanning Li, Jonathan R. Brennan
4) For Transformer-based models, both embeddings and attentions capture grammatical features but show distinct patterns.
no code implementations • 7 Oct 2023 • Peili Chen, Linyang He, Li Fu, Lu Fan, Edward F. Chang, Yuanning Li
Speech and language models trained through self-supervised learning (SSL) demonstrate strong alignment with brain activity during speech and language perception.