1 code implementation • • Casimiro Pio Carrino, Joan Llop, Marc Pàmies, Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé, Joaquín Silveira-Ocampo, Alfonso Valencia, Aitor Gonzalez-Agirre, Marta Villegas
This work presents the first large-scale biomedical Spanish language models trained from scratch, using large biomedical corpora consisting of a total of 1. 1B tokens and an EHR corpus of 95M tokens.
In this work, we present the Large Labelled Logo Dataset (L3D), a multipurpose, hand-labelled, continuously growing dataset.
Ranked #1 on Image Classification on Large Labelled Logo Dataset (L3D) (Eval F1 metric)
We introduce a new language representation model in finance called Financial Embedding Analysis of Sentiment (FinEAS).
We introduce CoWeSe (the Corpus Web Salud Espa\~nol), the largest Spanish biomedical corpus to date, consisting of 4. 5GB (about 750M tokens) of clean plain text.
To the best of our knowledge, we provide the first biomedical and clinical transformer-based pretrained language models for Spanish, intending to boost native Spanish NLP applications in biomedicine.
2 code implementations • 15 Jul 2021 • Asier Gutiérrez-Fandiño, Jordi Armengol-Estapé, Marc Pàmies, Joan Llop-Palao, Joaquín Silveira-Ocampo, Casimiro Pio Carrino, Aitor Gonzalez-Agirre, Carme Armentano-Oller, Carlos Rodriguez-Penagos, Marta Villegas
This work presents MarIA, a family of Spanish language models and associated resources made available to the industry and the research community.
The training of neural networks is usually monitored with a validation (holdout) set to estimate the generalization of the model.
We computed both Word and Sub-word Embeddings using FastText.
Characterizing the structural properties of neural networks is crucial yet poorly understood, and there are no well-established similarity measures between networks.
Email can be one of the most fruitful attack vectors of research institutions as they also contain access to all accounts and thus to all private information.
Cryptography and Security Social and Information Networks