no code implementations • 4 Apr 2024 • Tomás Vergara-Browne, Álvaro Soto, Akiko Aizawa
We introduce eigenpruning, a method that removes singular values from weight matrices in an LLM to improve its performance in a particular task.
no code implementations • 27 Oct 2022 • Joaquin Ossandón, Benjamin Earle, Álvaro Soto
In this work, we hypothesize that poor use of the visual information available is at the core of the low performance of current models.
no code implementations • nlppower (ACL) 2022 • Cristóbal Eyzaguirre, Felipe del Río, Vladimir Araujo, Álvaro Soto
Large-scale pre-trained language models have shown remarkable results in diverse NLP applications.