no code implementations • 27 Apr 2024 • Timothee Mickus, Raúl Vázquez, Joseph Attieh
Modularity is a paradigm of machine translation with the potential of bringing forth models that are large at training time and small during inference.
1 code implementation • 12 Mar 2024 • Timothee Mickus, Stig-Arne Grönroos, Joseph Attieh, Michele Boggia, Ona de Gibert, Shaoxiong Ji, Niki Andreas Lopi, Alessandro Raganato, Raúl Vázquez, Jörg Tiedemann
NLP in the age of monolithic large language models is approaching its limits in terms of size and information that can be handled.
no code implementations • 5 Feb 2024 • Timothee Mickus, Stig-Arne Grönroos, Joseph Attieh
Whether embedding spaces use all their dimensions equally, i. e., whether they are isotropic, has been a recent subject of discussion.