no code implementations • 7 Feb 2024 • Lihu Chen, Alexandre Perez-Lebel, Fabian M. Suchanek, Gaël Varoquaux
In this work, we construct a new evaluation dataset derived from a knowledge base to assess confidence scores given to answers of Mistral and LLaMA.
1 code implementation • 18 Jan 2024 • Lihu Chen, Gaël Varoquaux, Fabian M. Suchanek
The framework employs phrase type classification as an auxiliary task and incorporates character-level information more effectively into the phrase representation.
1 code implementation • 19 Oct 2023 • Lihu Chen, Gaël Varoquaux, Fabian M. Suchanek
Positional Encodings (PEs) are used to inject word-order information into transformer-based language models.
1 code implementation • 3 Feb 2023 • Lihu Chen, Gaël Varoquaux, Fabian M. Suchanek
Acronym Disambiguation (AD) is crucial for natural language understanding on various sources, including biomedical reports, scientific papers, and search engine queries.
2 code implementations • COLING 2022 • Cyril Chhun, Pierre Colombo, Chloé Clavel, Fabian M. Suchanek
However, there is no consensus on which human evaluation criteria to use, and no analysis of how well automatic criteria correlate with them.
1 code implementation • 15 Mar 2022 • Lihu Chen, Gaël Varoquaux, Fabian M. Suchanek
State-of-the-art NLP systems represent inputs with word embeddings, but these are brittle when faced with Out-of-Vocabulary (OOV) words.
1 code implementation • AKBC 2021 • Chadi Helwe, Chloé Clavel, Fabian M. Suchanek
Recent years have seen impressive performance of transformer-based models on different natural language processing tasks.
1 code implementation • AKBC 2021 • Pierre-Henri Paris, Syrine El Aoud, Fabian M. Suchanek
We manually analyze the frequency of vague noun phrases in a Wikipedia corpus, and find that 1/4 of noun phrases exhibit some form of vagueness.
1 code implementation • 16 Dec 2020 • Lihu Chen, Gaël Varoquaux, Fabian M. Suchanek
Biomedical entity linking aims to map biomedical mentions, such as diseases and drugs, to standard entities in a given knowledge base.