Search Results for author: Fabian M. Suchanek

Found 9 papers, 8 papers with code

Reconfidencing LLMs from the Grouping Loss Perspective

no code implementations7 Feb 2024 Lihu Chen, Alexandre Perez-Lebel, Fabian M. Suchanek, Gaël Varoquaux

In this work, we construct a new evaluation dataset derived from a knowledge base to assess confidence scores given to answers of Mistral and LLaMA.

Uncertainty Quantification

Learning High-Quality and General-Purpose Phrase Representations

1 code implementation18 Jan 2024 Lihu Chen, Gaël Varoquaux, Fabian M. Suchanek

The framework employs phrase type classification as an auxiliary task and incorporates character-level information more effectively into the phrase representation.

Contrastive Learning Data Augmentation +1

The Locality and Symmetry of Positional Encodings

1 code implementation19 Oct 2023 Lihu Chen, Gaël Varoquaux, Fabian M. Suchanek

Positional Encodings (PEs) are used to inject word-order information into transformer-based language models.

Sentence

GLADIS: A General and Large Acronym Disambiguation Benchmark

1 code implementation3 Feb 2023 Lihu Chen, Gaël Varoquaux, Fabian M. Suchanek

Acronym Disambiguation (AD) is crucial for natural language understanding on various sources, including biomedical reports, scientific papers, and search engine queries.

Language Modelling Natural Language Understanding

Of Human Criteria and Automatic Metrics: A Benchmark of the Evaluation of Story Generation

2 code implementations COLING 2022 Cyril Chhun, Pierre Colombo, Chloé Clavel, Fabian M. Suchanek

However, there is no consensus on which human evaluation criteria to use, and no analysis of how well automatic criteria correlate with them.

Story Generation

Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost

1 code implementation15 Mar 2022 Lihu Chen, Gaël Varoquaux, Fabian M. Suchanek

State-of-the-art NLP systems represent inputs with word embeddings, but these are brittle when faced with Out-of-Vocabulary (OOV) words.

Contrastive Learning Language Modelling +1

The Vagueness of Vagueness in Noun Phrases

1 code implementation AKBC 2021 Pierre-Henri Paris, Syrine El Aoud, Fabian M. Suchanek

We manually analyze the frequency of vague noun phrases in a Wikipedia corpus, and find that 1/4 of noun phrases exhibit some form of vagueness.

Position

A Lightweight Neural Model for Biomedical Entity Linking

1 code implementation16 Dec 2020 Lihu Chen, Gaël Varoquaux, Fabian M. Suchanek

Biomedical entity linking aims to map biomedical mentions, such as diseases and drugs, to standard entities in a given knowledge base.

Entity Linking

Cannot find the paper you are looking for? You can Submit a new open access paper.