Search Results for author:
Found 10 papers, 4 papers with code
Pretrained Biomedical Language Models for Clinical NLP in Spanish
This work presents the first large-scale biomedical Spanish language models trained from scratch, using large biomedical corpora consisting of a total of 1. 1B tokens and an EHR corpus of 95M tokens.
Promoting Generalized Cross-lingual Question Answering in Few-resource Scenarios via Self-knowledge Distillation
Our approach seeks to enhance cross-lingual QA transfer using a high-performing multilingual model trained on a large-scale dataset, complemented by a few thousand aligned QA examples across languages.
Spanish Biomedical Crawled Corpus: A Large, Diverse Dataset for Spanish Biomedical Language Models
We introduce CoWeSe (the Corpus Web Salud Espa\~nol), the largest Spanish biomedical corpus to date, consisting of 4. 5GB (about 750M tokens) of clean plain text.
Biomedical and Clinical Language Models for Spanish: On the Benefits of Domain-Specific Pretraining in a Mid-Resource Scenario
To the best of our knowledge, we provide the first biomedical and clinical transformer-based pretrained language models for Spanish, intending to boost native Spanish NLP applications in biomedicine.
Are Multilingual Models the Best Choice for Moderately Under-resourced Languages? A Comprehensive Assessment for Catalan
For this, we: (1) build a clean, high-quality textual Catalan corpus (CaText), the largest to date (but only a fraction of the usual size of the previous work in monolingual language models), (2) train a Transformer-based language model for Catalan (BERTa), and (3) devise a thorough evaluation in a diversity of settings, comprising a complete array of downstream tasks, namely, Part of Speech Tagging, Named Entity Recognition and Classification, Text Classification, Question Answering, and Semantic Textual Similarity, with most of the corresponding datasets being created ex novo.
MarIA: Spanish Language Models
This work presents MarIA, a family of Spanish language models and associated resources made available to the industry and the research community.
Spanish Biomedical and Clinical Language Embeddings
We computed both Word and Sub-word Embeddings using FastText.
Automatic Spanish Translation of SQuAD Dataset for Multi-lingual Question Answering
We then used this dataset to train Spanish QA systems by fine-tuning a Multilingual-BERT model.
Automatic Spanish Translation of the SQuAD Dataset for Multilingual Question Answering
We then used this dataset to train Spanish QA systems by fine-tuning a Multilingual-BERT model.
Terminology-Aware Segmentation and Domain Feature for the WMT19 Biomedical Translation Task
Our best-submitted system ranked 2nd and 3rd for Spanish-English and English-Spanish translation directions, respectively.
