Search Results for author: Asahi Ushio

Found 17 papers, 12 papers with code

RelBERT: Embedding Relations with Language Models

1 code implementation30 Sep 2023 Asahi Ushio, Jose Camacho-Collados, Steven Schockaert

In particular, we show that masked language models such as RoBERTa can be straightforwardly fine-tuned for this purpose, using only a small amount of training data.

Knowledge Graphs

A Practical Toolkit for Multilingual Question and Answer Generation

1 code implementation27 May 2023 Asahi Ushio, Fernando Alva-Manchego, Jose Camacho-Collados

Generating questions along with associated answers from a text has applications in several domains, such as creating reading comprehension tests for students, or improving document search by providing auxiliary questions and answers based on the query.

Answer Generation Reading Comprehension +1

An Empirical Comparison of LM-based Question and Answer Generation Methods

1 code implementation26 May 2023 Asahi Ushio, Fernando Alva-Manchego, Jose Camacho-Collados

This task has a variety of applications, such as data augmentation for question answering (QA) models, information retrieval and education.

Answer Generation Data Augmentation +4

An Efficient Multilingual Language Model Compression through Vocabulary Trimming

1 code implementation24 May 2023 Asahi Ushio, Yi Zhou, Jose Camacho-Collados

Multilingual language model (LM) have become a powerful tool in NLP especially for non-English languages.

Language Modelling Model Compression

A RelEntLess Benchmark for Modelling Graded Relations between Named Entities

no code implementations24 May 2023 Asahi Ushio, Jose Camacho Collados, Steven Schockaert

Relations such as "is influenced by", "is known for" or "is a competitor of" are inherently graded: we can rank entity pairs based on how well they satisfy these relations, but it is hard to draw a line between those pairs that satisfy them and those that do not.

Knowledge Graphs Relation

Generative Language Models for Paragraph-Level Question Generation

1 code implementation8 Oct 2022 Asahi Ushio, Fernando Alva-Manchego, Jose Camacho-Collados

It includes general-purpose datasets such as SQuAD for English, datasets from ten domains and two styles, as well as datasets in eight different languages.

Question Answering Question Generation +1

Guiding Generative Language Models for Data Augmentation in Few-Shot Text Classification

no code implementations17 Nov 2021 Aleksandra Edwards, Asahi Ushio, Jose Camacho-Collados, Hélène de Ribaupierre, Alun Preece

Data augmentation techniques are widely used for enhancing the performance of machine learning models by tackling class imbalance issues and data sparsity.

Active Learning Data Augmentation +2

Distilling Relation Embeddings from Pre-trained Language Models

1 code implementation21 Sep 2021 Asahi Ushio, Jose Camacho-Collados, Steven Schockaert

Among others, this makes it possible to distill high-quality word vectors from pre-trained language models.

Knowledge Graphs Language Modelling +2

Latent Space Cartography: Generalised Metric-Inspired Measures and Measure-Based Transformations for Generative Models

no code implementations6 Feb 2019 Max F. Frenzel, Bogdan Teleaga, Asahi Ushio

Deep generative models are universal tools for learning data distributions on high dimensional data spaces via a mapping to lower dimensional latent spaces.

Cannot find the paper you are looking for? You can Submit a new open access paper.