Search Results for author: Vladimir Araujo

Found 13 papers, 5 papers with code

ALBETO and DistilBETO: Lightweight Spanish Language Models

1 code implementation19 Apr 2022 José Cañete, Sebastián Donoso, Felipe Bravo-Marquez, Andrés Carvallo, Vladimir Araujo

In this paper we present ALBETO and DistilBETO, which are versions of ALBERT and DistilBERT pre-trained exclusively on Spanish corpora.

Natural Language Understanding NER +1

Entropy-based Stability-Plasticity for Lifelong Learning

1 code implementation18 Apr 2022 Vladimir Araujo, Julio Hurtado, Alvaro Soto, Marie-Francine Moens

The ability to continuously learn remains elusive for deep learning models.

Augmenting BERT-style Models with Predictive Coding to Improve Discourse-level Representations

no code implementations EMNLP 2021 Vladimir Araujo, Andrés Villa, Marcelo Mendoza, Marie-Francine Moens, Alvaro Soto

Current language models are usually trained using a self-supervised scheme, where the main focus is learning representations at the word or sentence level.

Stress Test Evaluation of Biomedical Word Embeddings

1 code implementation NAACL (BioNLP) 2021 Vladimir Araujo, Andrés Carvallo, Carlos Aspillaga, Camilo Thorne, Denis Parra

The success of pretrained word embeddings has motivated their use in the biomedical domain, with contextualized embeddings yielding remarkable results in several biomedical NLP tasks.

named-entity-recognition NER +1

Interpretable Contextual Team-aware Item Recommendation: Application in Multiplayer Online Battle Arena Games

1 code implementation30 Jul 2020 Andrés Villa, Vladimir Araujo, Francisca Cattan, Denis Parra

Our evaluation indicates that both the Transformer architecture and the contextual information are essential to get the best results for this item recommendation task.

Recommendation Systems

Translating Natural Language Instructions for Behavioral Robot Navigation with a Multi-Head Attention Mechanism

no code implementations WS 2020 Patricio Cerda-Mardini, Vladimir Araujo, Alvaro Soto

We propose a multi-head attention mechanism as a blending layer in a neural network model that translates natural language to a high level behavioral language for indoor robot navigation.

Robot Navigation

On Adversarial Examples for Biomedical NLP Tasks

no code implementations23 Apr 2020 Vladimir Araujo, Andres Carvallo, Carlos Aspillaga, Denis Parra

We also show that we can significantly improve the robustness of the models by training them with adversarial examples.

Language Modelling named-entity-recognition +3

Stress Test Evaluation of Transformer-based Models in Natural Language Understanding Tasks

no code implementations LREC 2020 Carlos Aspillaga, Andrés Carvallo, Vladimir Araujo

There has been significant progress in recent years in the field of Natural Language Processing thanks to the introduction of the Transformer architecture.

Natural Language Inference Natural Language Processing +2

Cannot find the paper you are looking for? You can Submit a new open access paper.