1 code implementation • 27 Jun 2024 • Andrea Bacciu, Marco Damonte, Marco Basaldella, Emilio Monti
We then present a novel hallucination detection strategy that exploits the computational graph of the NSP model to detect the NSP hallucinations in the presence of ontology gaps, out-of-domain utterances, and to recognize NSP errors, improving the F1-Score respectively by ~21, ~24% and ~1%.
no code implementations • 29 May 2024 • Michael Regan, Shira Wein, George Baker, Emilio Monti
Abstract Meaning Representation (AMR) is a semantic formalism that captures the core meaning of an utterance.
1 code implementation • 4 May 2024 • Zheng Zhao, Emilio Monti, Jens Lehmann, Haytham Assem
Large language models (LLMs) tend to inadequately integrate input context during text generation, relying excessively on encoded prior knowledge in model parameters, potentially resulting in generated text with factual inconsistencies or contextually unfaithful content.
no code implementations • 8 Jan 2024 • Peter Vickers, Loïc Barrault, Emilio Monti, Nikolaos Aletras
In Natural Language Processing (NLP) classification tasks such as topic categorisation and sentiment analysis, model generalizability is generally measured with standard metrics such as Accuracy, F-Measure, or AUC-ROC.
1 code implementation • 28 Jan 2023 • Laura Perez-Beltrachini, Parag Jain, Emilio Monti, Mirella Lapata
In this paper, we are interested in developing semantic parsers which understand natural language questions embedded in a conversation with a user and ground them to formal queries over definitions in a general purpose knowledge graph (KG) with very large vocabularies (covering thousands of concept names and relations, and millions of entities).
no code implementations • ACL 2021 • Peter Vickers, Nikolaos Aletras, Emilio Monti, Lo{\"\i}c Barrault
Visual Question Answering (VQA) methods aim at leveraging visual input to answer questions that may require complex reasoning over entities.
no code implementations • Joint Conference on Lexical and Computational Semantics 2021 • Marco Damonte, Emilio Monti
The lack of a single standard for meaning representations led to the creation of a plethora of semantic parsing datasets.
1 code implementation • Joint Conference on Lexical and Computational Semantics 2021 • Menglin Xia, Emilio Monti
To evaluate our multilingual models on human-written sentences as opposed to machine translated ones, we introduce a new multilingual semantic parsing dataset in English, Italian and Japanese based on the Facebook Task Oriented Parsing (TOP) dataset.
no code implementations • 30 Jan 2020 • Subendhu Rongali, Luca Soldaini, Emilio Monti, Wael Hamza
Virtual assistants such as Amazon Alexa, Apple Siri, and Google Assistant often rely on a semantic parsing component to understand which action(s) to execute for an utterance spoken by its users.
no code implementations • WS 2017 • Xing Fan, Emilio Monti, Lambert Mathias, Markus Dreyer
The goal of semantic parsing is to map natural language to a machine interpretable meaning representation language (MRL).