no code implementations • LREC 2022 • Joel Oksanen, Abhilash Majumder, Kumar Saunack, Francesca Toni, Arun Dhondiyal
Our method creatively integrates existing resources to construct automatically a knowledge graph of companies and related entities as well as to carry out unsupervised analysis of the resulting graph to provide quantifiable and explainable insights from the produced knowledge.
no code implementations • ACL (InterNLP) 2021 • Hugo Zylberajch, Piyawat Lertvittayakumjorn, Francesca Toni
Biases and artifacts in training data can cause unwelcome behavior in text classifiers (such as shallow pattern matching), leading to lack of generalizability.
no code implementations • 18 Apr 2025 • Gabriel Freedman, Francesca Toni
Advances in the general capabilities of large language models (LLMs) have led to their use for information retrieval, and as components in automated decision systems.
1 code implementation • 21 Feb 2025 • Lihu Chen, Shuojie Fu, Gabriel Freedman, Cemre Zor, Guy Martin, James Kinross, Uddhav Vaghela, Ovidiu Serban, Francesca Toni
We propose Pub-Guard-LLM, the first large language model-based system tailored to fraud detection of biomedical scientific articles.
1 code implementation • 18 Feb 2025 • Avinash Kori, Antonio Rago, Francesca Toni
Deep learning models are powerful image classifiers but their opacity hinders their trustworthiness.
no code implementations • 29 Oct 2024 • Antonio Rago, Stylianos Loukas Vasileiou, Francesca Toni, Tran Cao Son, William Yeoh
Gradual semantics (GS) have demonstrated great potential in argumentation, in particular for deploying quantitative bipolar argumentation frameworks (QBAFs) in a number of real-world settings, from judgmental forecasting to explainable AI.
no code implementations • 7 Oct 2024 • Ken Satoh, Ha-Thanh Nguyen, Francesca Toni, Randy Goebel, Kostas Stathis
Reasoning is an essential component of human intelligence as it plays a fundamental role in our ability to think critically, support responsible decisions, and solve challenging problems.
no code implementations • 25 Sep 2024 • Purin Sukpanichnant, Anna Rapberger, Francesca Toni
We evaluate the performance of the PeerArg pipeline on three different datasets, in comparison with a novel end-2-end LLM that uses few-shot learning to predict paper acceptance given reviews.
1 code implementation • 9 Sep 2024 • Xiang Yin, Nico Potyka, Francesca Toni
Explaining the strength of arguments under gradual semantics is receiving increasing attention.
no code implementations • 30 Aug 2024 • Antonio Rago, Bence Palfi, Purin Sukpanichnant, Hannibal Nabli, Kavyesh Vivek, Olga Kostopoulou, James Kinross, Francesca Toni
In both studies we found a clear preference in terms of subjective comprehension and trust for occlusion-1 over SHAP explanations in general, when comparing based on content.
no code implementations • 19 Aug 2024 • Emanuele De Angelis, Maurizio Proietti, Francesca Toni
Assumption-based Argumentation (ABA) is advocated as a unifying formalism for various forms of non-monotonic reasoning, including logic programming.
no code implementations • 31 Jul 2024 • Adam Gould, Guilherme Paulino-Passos, Seema Dadhania, Matthew Williams, Francesca Toni
We prove that the model inherently follows these preferences when making predictions and show that previous abstract argumentation for case-based reasoning approaches are insufficient at expressing preferences over constituents of an argument.
1 code implementation • 11 Jul 2024 • Xiang Yin, Nico Potyka, Francesca Toni
There is a growing interest in understanding arguments' strength in Quantitative Bipolar Argumentation Frameworks (QBAFs).
1 code implementation • 19 Jun 2024 • Xuehao Zhai, Junqi Jiang, Adam Dejl, Antonio Rago, Fangce Guo, Francesca Toni, Aruna Sivakumar
Urban land use inference is a critically important task that aids in city planning and policy-making.
1 code implementation • 16 Jun 2024 • Lihu Chen, Adam Dejl, Francesca Toni
(3) Are there localized knowledge regions in LLMs?
1 code implementation • 11 Jun 2024 • Avinash Kori, Francesco Locatello, Ainkaran Santhirasekaram, Francesca Toni, Ben Glocker, Fabio De Sousa Ribeiro
Learning modular object-centric representations is crucial for systematic generalization.
1 code implementation • 18 May 2024 • Fabrizio Russo, Anna Rapberger, Francesca Toni
Causal discovery amounts to unearthing causal relationships amongst features in data.
no code implementations • 17 May 2024 • Francesco Leofante, Hamed Ayoobi, Adam Dejl, Gabriel Freedman, Deniz Gorur, Junqi Jiang, Guilherme Paulino-Passos, Antonio Rago, Anna Rapberger, Fabrizio Russo, Xiang Yin, Dekai Zhang, Francesca Toni
AI has become pervasive in recent years, but state-of-the-art approaches predominantly neglect the need for AI systems to be contestable.
no code implementations • 15 May 2024 • Anna Rapberger, Markus Ulbricht, Francesca Toni
The relation between (a fragment of) assumption-based argumentation (ABA) and logic programs (LPs) under stable model semantics is well-studied.
no code implementations • 3 May 2024 • Gabriel Freedman, Adam Dejl, Deniz Gorur, Xiang Yin, Antonio Rago, Francesca Toni
The interpretable nature of these argumentation frameworks and formal reasoning means that any decision made by ArgLLMs may be explained and contested.
1 code implementation • 22 Apr 2024 • Xiang Yin, Potyka Nico, Francesca Toni
In this paper, we propose a novel theory of Relation Attribution Explanations (RAEs), adapting Shapley values from game theory to offer fine-grained insights into the role of attacks and supports in quantitative bipolar argumentation towards obtaining the arguments' strength.
1 code implementation • 21 Apr 2024 • Junqi Jiang, Francesco Leofante, Antonio Rago, Francesca Toni
We present procedures to verify $\Delta$-robustness based on Mixed Integer Linear Programming, using which we further propose algorithms to generate CEs that are $\Delta$-robust.
1 code implementation • 17 Apr 2024 • Tuomo Lehtonen, Anna Rapberger, Francesca Toni, Markus Ulbricht, Johannes P. Wallner
We make use of a semantics-preserving translation between ABA and bipolar argumentation frameworks (BAFs).
1 code implementation • 29 Mar 2024 • Neema Kotonya, Francesca Toni
As deep neural models in NLP become more complex, and as a consequence opaque, the necessity to interpret them becomes greater.
no code implementations • 17 Feb 2024 • Deniz Gorur, Antonio Rago, Francesca Toni
Argument mining (AM) is the process of automatically extracting arguments, their components and/or relations amongst arguments and components from text.
no code implementations • 11 Feb 2024 • Francis Rhys Ward, Matt MacDermott, Francesco Belardinelli, Francesca Toni, Tom Everitt
In addition, we show how our definition relates to past concepts, including actual causality, and the notion of instrumental goals, which is a core idea in the literature on safe AI agents.
no code implementations • 2 Feb 2024 • Junqi Jiang, Francesco Leofante, Antonio Rago, Francesca Toni
Counterfactual explanations (CEs) are advocated as being ideally suited to providing algorithmic recourse for subjects affected by the predictions of machine learning models.
no code implementations • 16 Jan 2024 • Timotheus Kampik, Nico Potyka, Xiang Yin, Kristijonas Čyras, Francesca Toni
We present a principle-based analysis of contribution functions for quantitative bipolar argumentation graphs that quantify the contribution of one argument to another.
1 code implementation • 22 Dec 2023 • Junqi Jiang, Antonio Rago, Francesco Leofante, Francesca Toni
Model Multiplicity (MM) arises when multiple, equally performing machine learning models can be trained to solve the same prediction task.
1 code implementation • 18 Dec 2023 • Fabrizio Russo, Francesca Toni
Causal Structure Learning (CSL), also referred to as causal discovery, amounts to extracting causal relations among variables in data.
no code implementations • NeurIPS 2023 • Francis Rhys Ward, Francesco Belardinelli, Francesca Toni, Tom Everitt
There are a number of existing definitions of deception in the literature on game theory and symbolic AI, but there is no overarching theory of deception for learning agents in games.
no code implementations • 26 Nov 2023 • Hamed Ayoobi, Nico Potyka, Francesca Toni
We propose ProtoArgNet, a novel interpretable deep neural architecture for image classification in the spirit of prototypical-part-learning as found, e. g., in ProtoPNet.
no code implementations • 31 Oct 2023 • Adam Dejl, Hamed Ayoobi, Matthew Williams, Francesca Toni
Feature attribution methods are widely used to explain neural models by determining the influence of individual input features on the models' outputs.
no code implementations • 30 Oct 2023 • Guilherme Paulino-Passos, Francesca Toni
Specifically, we show that, for two legal datasets, AA-CBR and decision-tree-based learning of case relevance perform competitively in comparison with decision trees.
1 code implementation • 22 Sep 2023 • Dekai Zhang, Matthew Williams, Francesca Toni
Recent methods tackle this problem by training NNs with additional ground-truth annotations of such signals.
1 code implementation • 22 Sep 2023 • Junqi Jiang, Jianglin Lan, Francesco Leofante, Antonio Rago, Francesca Toni
In this work, we propose Provably RObust and PLAusible Counterfactual Explanations (PROPLACE), a method leveraging on robust optimisation techniques to address the aforementioned limitations in the literature.
no code implementations • 11 Sep 2023 • Ha-Thanh Nguyen, Randy Goebel, Francesca Toni, Kostas Stathis, Ken Satoh
The evolution of Generative Pre-trained Transformer (GPT) models has led to significant advancements in various natural language processing applications, particularly in legal textual entailment.
no code implementations • 30 Aug 2023 • Emanuele De Angelis, Maurizio Proietti, Francesca Toni
Recently, ABA Learning has been proposed as a form of symbolic machine learning for drawing Assumption-Based Argumentation frameworks from background knowledge and positive and negative examples.
no code implementations • 30 Aug 2023 • Francesca Toni, Nico Potyka, Markus Ulbricht, Pietro Totis
ProbLog is a popular probabilistic logic programming language/tool, widely used for applications requiring to deal with inherent uncertainties in structured domains.
no code implementations • 28 Aug 2023 • Enrico Pontelli, Stefania Costantini, Carmine Dodaro, Sarah Gaggl, Roberta Calegari, Artur d'Avila Garcez, Francesco Fabiano, Alessandra Mileo, Alessandra Russo, Francesca Toni
This volume contains the Technical Communications presented at the 39th International Conference on Logic Programming (ICLP 2023), held at Imperial College London, UK from July 9 to July 15, 2023.
no code implementations • 25 Jul 2023 • Xiang Yin, Nico Potyka, Francesca Toni
Argumentative explainable AI has been advocated by several in recent years, with an increasing interest on explaining the reasoning outcomes of Argumentation Frameworks (AFs).
no code implementations • 18 Jul 2023 • Avinash Kori, Francesco Locatello, Fabio De Sousa Ribeiro, Francesca Toni, Ben Glocker
The extraction of modular object-centric representations for downstream tasks is an emerging area of research.
no code implementations • 29 Jun 2023 • Ha Thanh Nguyen, Randy Goebel, Francesca Toni, Kostas Stathis, Ken Satoh
Negation is a fundamental aspect of natural language, playing a critical role in communication and comprehension.
1 code implementation • 26 Jun 2023 • Stylianos Loukas Vasileiou, Ashwin Kumar, William Yeoh, Tran Cao Son, Francesca Toni
We present a novel framework designed to extend model reconciliation approaches, commonly used in human-aware planning, for enhanced human-AI interaction.
no code implementations • 25 May 2023 • Maurizio Proietti, Francesca Toni
We present a general strategy that applies the transformation rules in a suitable order to learn stratified frameworks, and we also propose a variant that handles the non-stratified case.
no code implementations • 21 May 2023 • Markus Ulbricht, Nico Potyka, Anna Rapberger, Francesca Toni
Assumption-based Argumentation (ABA) is a well-known structured argumentation formalism, whereby arguments and attacks between them are drawn from rules, defeasible assumptions and their contraries.
no code implementations • 27 Mar 2023 • Antonio Rago, Hengzhi Li, Francesca Toni
As the field of explainable AI (XAI) is maturing, calls for interactive explanations for (the outputs of) AI models are growing, but the state-of-the-art predominantly focuses on static explanations.
1 code implementation • 23 Jan 2023 • Hamed Ayoobi, Nico Potyka, Francesca Toni
Neural networks (NNs) have various applications in AI, but explaining their decisions remains challenging.
no code implementations • 21 Nov 2022 • Nico Potyka, Xiang Yin, Francesca Toni
Random forests are decision tree ensembles that can be used to solve a variety of machine learning problems.
1 code implementation • 17 Oct 2022 • Avinash Kori, Ben Glocker, Francesca Toni
An effective way to obtain different perspectives on any given topic is by conducting a debate, where participants argue for and against the topic.
no code implementations • 28 Sep 2022 • Francis Rhys Ward, Francesco Belardinelli, Francesca Toni
We define a novel neuro-symbolic framework, argumentative reward learning, which combines preference-based argumentation with existing approaches to reinforcement learning from human feedback.
1 code implementation • 31 Aug 2022 • Junqi Jiang, Francesco Leofante, Antonio Rago, Francesca Toni
Existing attempts towards solving this problem are heuristic, and the robustness to model changes of the resulting CFXs is evaluated with only a small number of retrained models, failing to provide exhaustive guarantees.
no code implementations • 30 Jul 2022 • Guilherme Paulino-Passos, Francesca Toni
To better analyse this issue, in this work we treat explanations as objects that can be subject to reasoning and present a formal model of the interactive scenario between user and system, via sequences of inputs, outputs, and explanations.
no code implementations • 11 Jul 2022 • Dekai Zhang, Francesca Toni, Matthew Williams
Recent research has shown the potential for neural networks to improve upon classical survival models such as the Cox model, which is widely used in clinical practice.
1 code implementation • 5 Jul 2022 • Ainkaran Santhirasekaram, Avinash Kori, Andrea Rockall, Mathias Winkler, Francesca Toni, Ben Glocker
We achieve this by using the natural properties of \emph{hyperbolic geometry} to more efficiently model a hierarchy of symbolic features and generate \emph{hierarchical symbolic rules} as part of our explanations.
no code implementations • 5 Jul 2022 • Avinash Kori, Ben Glocker, Francesca Toni
Specifically, we provide a generator to visualize the `effect' of interactions among features in latent space and draw feature importance therefrom as local explanations.
no code implementations • 23 May 2022 • Antonio Rago, Pietro Baroni, Francesca Toni
Causal models are playing an increasingly important role in machine learning, particularly in the realm of explainable AI.
no code implementations • 23 May 2022 • Benjamin Irwin, Antonio Rago, Francesca Toni
We introduce Forecasting Argumentation Frameworks (FAFs), a novel argumentation-based methodology for forecasting informed by recent judgmental forecasting research.
no code implementations • 22 May 2022 • Piyawat Lertvittayakumjorn, Francesca Toni
Hence, we propose AXPLR, a novel explanation method using (forms of) computational argumentation to generate explanations (for outputs computed by PLR) which unearth model agreements and disagreements among the features.
1 code implementation • 19 May 2022 • Fabrizio Russo, Francesca Toni
Neural networks have proven to be effective at solving machine learning tasks but it is unclear whether they learn any relevant causal relationships, while their black-box nature makes it difficult for modellers to understand and debug them.
no code implementations • 19 May 2022 • Nico Potyka, Xiang Yin, Francesca Toni
There is broad agreement in the literature that explanation methods should be faithful to the model that they explain, but faithfulness remains a rather vague term.
1 code implementation • 29 Apr 2022 • Alexander Gaskell, Yishu Miao, Lucia Specia, Francesca Toni
We propose a novel, generative adversarial framework for probing and improving these models' reasoning capabilities.
1 code implementation • 26 Jan 2022 • Ion Stagkos Efstathiadis, Guilherme Paulino-Passos, Francesca Toni
The forum r/AmITheAsshole in Reddit hosts discussion on moral issues based on concrete narratives presented by users.
no code implementations • 18 Jan 2022 • Xiuyi Fan, Francesca Toni
It is widely acknowledged that transparency of automated decision making is crucial for deployability of intelligent systems, and explaining the reasons why some decisions are "good" and some are not is a way to achieving this transparency.
no code implementations • EMNLP (FEVER) 2021 • Neema Kotonya, Thomas Spooner, Daniele Magazzeni, Francesca Toni
This paper presents an end-to-end system for fact extraction and verification using textual and tabular evidence, the performance of which we demonstrate on the FEVEROUS dataset.
no code implementations • 13 Jul 2021 • Guilherme Paulino-Passos, Francesca Toni
We then define a variation of $AA{\text -} CBR_{\succeq}$ which is cautiously monotonic.
no code implementations • 28 May 2021 • Oana Cocarascu, Andrew McLean, Paul French, Francesca Toni
The success of research institutions heavily relies upon identifying the right researchers "for the job": researchers may need to identify appropriate collaborators, often from across disciplines; students may need to identify suitable supervisors for projects of their interest; administrators may need to match funding opportunities with relevant researchers, and so on.
no code implementations • 24 May 2021 • Kristijonas Čyras, Antonio Rago, Emanuele Albini, Pietro Baroni, Francesca Toni
Explainable AI (XAI) has been investigated for decades and, together with AI itself, has witnessed unprecedented growth in recent years.
no code implementations • 23 May 2021 • Joel Oksanen, Oana Cocarascu, Francesca Toni
Ontologies have proven beneficial in different settings that make use of textual reviews.
no code implementations • 30 Apr 2021 • Piyawat Lertvittayakumjorn, Francesca Toni
Debugging a machine learning model is hard since the bug usually involves the training data and the learning process.
1 code implementation • LREC 2022 • Piyawat Lertvittayakumjorn, Leshem Choshen, Eyal Shnarch, Francesca Toni
Data exploration is an important step of every data science and machine learning project, including those involving textual data.
no code implementations • 4 Feb 2021 • Stefan Lauren, Francesco Belardinelli, Francesca Toni
We introduce a novel method to aggregate Bipolar Argumentation (BA) Frameworks expressing opinions by different parties in debates.
no code implementations • 10 Dec 2020 • Antonio Rago, Emanuele Albini, Pietro Baroni, Francesca Toni
One of the most pressing issues in AI in recent years has been the need to address the lack of explainability of many of its models.
no code implementations • 10 Dec 2020 • Emanuele Albini, Piyawat Lertvittayakumjorn, Antonio Rago, Francesca Toni
Despite the recent, widespread focus on eXplainable AI (XAI), explanations computed by XAI methods tend to provide little insight into the functioning of Neural Networks (NNs).
Explainable Artificial Intelligence (XAI)
Text Classification
1 code implementation • COLING 2020 • Neema Kotonya, Francesca Toni
A number of exciting advances have been made in automated fact-checking thanks to increasingly larger datasets and more powerful systems, leading to improvements in the complexity of claims which can be accurately fact-checked.
2 code implementations • EMNLP 2020 • Neema Kotonya, Francesca Toni
We present the first study of explainable fact-checking for claims which require specific expertise.
1 code implementation • EMNLP 2020 • Piyawat Lertvittayakumjorn, Lucia Specia, Francesca Toni
Since obtaining a perfect training dataset (i. e., a dataset which is considerably large, unbiased, and well-representative of unseen cases) is hardly possible, many real-world text classifiers are trained on the available, yet imperfect, datasets.
no code implementations • 10 Jul 2020 • Guilherme Paulino-Passos, Francesca Toni
Recently, abstract argumentation-based models of case-based reasoning ($AA{\text -}CBR$ in short) have been proposed, originally inspired by the legal domain, but also applicable as classifiers in different scenarios, including image classification, sentiment analysis of text, and in predicting the passage of bills in the UK Parliament.
no code implementations • 14 Feb 2020 • Oana Cocarascu, Elena Cabrio, Serena Villata, Francesca Toni
Argument Mining is the research area which aims at extracting argument components and predicting argumentative relations (i. e., support and attack) from text.
no code implementations • 12 Dec 2019 • Ria Jha, Francesco Belardinelli, Francesca Toni
Such transition systems can model debates and represent their evolution over time using a finite set of states.
no code implementations • 31 Aug 2019 • M. Tarik Altuncu, Eloise Sorin, Joshua D. Symons, Erik Mayer, Sophia N. Yaliraki, Francesca Toni, Mauricio Barahona
The large volume of text in electronic healthcare records often remains underused due to a lack of methodologies to extract interpretable content.
1 code implementation • IJCNLP 2019 • Piyawat Lertvittayakumjorn, Francesca Toni
Due to the black-box nature of deep learning models, methods for explaining the models' results are crucial to gain trust from humans and support collaboration between AIs and humans.
no code implementations • WS 2019 • Neema Kotonya, Francesca Toni
One very important stage in employing stance detection for fake news detection is the aggregation of multiple stance labels from different text sources in order to compute a prediction for the veracity of a claim.
no code implementations • 5 Mar 2019 • Amin Karamlou, Kristijonas Čyras, Francesca Toni
Bipolar Argumentation Frameworks (BAFs) admit several interpretations of the support relation and diverging definitions of semantics.
no code implementations • CL 2018 • Oana Cocarascu, Francesca Toni
In this article, we focus on analyzing whether news headlines support tweets and whether reviews are deceptive by analyzing the interaction or the influence that these texts have on the others, thus exploiting contextual information.
no code implementations • 13 Nov 2018 • Kristijonas Čyras, Dimitrios Letsios, Ruth Misener, Francesca Toni
Specifically, we define argumentative and natural language explanations for why a schedule is (not) feasible, (not) efficient or (not) satisfying fixed user decisions, based on models of the fundamental makespan scheduling problem in terms of abstract argumentation frameworks (AFs).
no code implementations • EMNLP 2017 • Oana Cocarascu, Francesca Toni
We propose a deep learning architecture to capture argumentative relations of attack and support from one piece of text to another, of the kind that naturally occur in a debate.
no code implementations • 10 Oct 2016 • Kristijonas Čyras, Francesca Toni
We present ABA+, a new approach to handling preferences in a well known structured argumentation formalism, Assumption-Based Argumentation (ABA).
no code implementations • 29 Mar 2016 • Kristijonas Cyras, Francesca Toni
We investigate properties of ABA+, a formalism that extends the well studied structured argumentation formalism Assumption-Based Argumentation (ABA) with a preference handling mechanism.
no code implementations • 20 Nov 2014 • Claudia Schulz, Francesca Toni
An answer set is a plain set of literals which has no further structure that would explain why certain literals are part of it and why others are not.
no code implementations • 15 Jan 2014 • Antonis Kakas, Paolo Mancarella, Fariba Sadri, Kostas Stathis, Francesca Toni
This paper presents the computational logic foundations of a model of agency called the KGP (Knowledge, Goals and Plan model.