Search Results for author: Andreas Vlachos

Found 98 papers, 38 papers with code

Leveraging Wikipedia article evolution for promotional tone detection

1 code implementation ACL 2022 Christine de Kock, Andreas Vlachos

Detecting biased language is useful for a variety of applications, such as identifying hyperpartisan news sources or flagging one-sided rhetoric.

The Fact Extraction and VERification Over Unstructured and Structured information (FEVEROUS) Shared Task

no code implementations EMNLP (FEVER) 2021 Rami Aly, Zhijiang Guo, Michael Sejr Schlichtkrull, James Thorne, Andreas Vlachos, Christos Christodoulopoulos, Oana Cocarascu, Arpit Mittal

The Fact Extraction and VERification Over Unstructured and Structured information (FEVEROUS) shared task, asks participating systems to determine whether human-authored claims are Supported or Refuted based on evidence retrieved from Wikipedia (or NotEnoughInfo if the claim cannot be verified).

Retrieval

Collaborative Evaluation of Deepfake Text with Deliberation-Enhancing Dialogue Systems

no code implementations6 Mar 2025 Jooyoung Lee, Xiaochen Zhu, Georgi Karadzhov, Tom Stafford, Andreas Vlachos, Dongwon Lee

In this study, we explore the potential of DeepFakeDeLiBot, a deliberation-enhancing chatbot, to support groups in detecting deepfake text.

Chatbot Diversity +2

The Future Outcome Reasoning and Confidence Assessment Benchmark

no code implementations27 Feb 2025 Zhangdie Yuan, Zifeng Ding, Andreas Vlachos

Forecasting is an important task in many domains, such as technology and economics.

Prediction

Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey

1 code implementation16 Dec 2024 Liang Chen, Zekun Wang, Shuhuai Ren, Lei LI, Haozhe Zhao, Yunshui Li, Zefan Cai, Hongcheng Guo, Lei Zhang, Yizhe Xiong, Yichi Zhang, Ruoyu Wu, Qingxiu Dong, Ge Zhang, Jian Yang, Lingwei Meng, Shujie Hu, Yulong Chen, Junyang Lin, Shuai Bai, Andreas Vlachos, Xu Tan, Minjia Zhang, Wen Xiao, Aaron Yee, Tianyu Liu, Baobao Chang

As Large Language Models (LLMs) have advanced to unify understanding and generation tasks within the textual modality, recent research has shown that tasks from different modalities can also be effectively encapsulated within the NTP framework, transforming the multimodal information into tokens and predict the next one given the context.

Language Modeling Language Modelling +2

Segment-Level Diffusion: A Framework for Controllable Long-Form Generation with Diffusion Language Models

no code implementations15 Dec 2024 Xiaochen Zhu, Georgi Karadzhov, Chenxi Whitehouse, Andreas Vlachos

Diffusion models have shown promise in text generation but often struggle with generating long, coherent, and contextually accurate text.

Contrastive Learning Decoder +4

A Bayesian Optimization Approach to Machine Translation Reranking

no code implementations14 Nov 2024 Julius Cheng, Maike Züfle, Vilém Zouhar, Andreas Vlachos

Reranking a list of candidates from a machine translation system with an external scoring model and returning the highest-scoring candidate remains a simple and effective method for improving the overall output quality.

Bayesian Optimization Machine Translation +1

Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checking

no code implementations8 Nov 2024 Mubashara Akhtar, Michael Schlichtkrull, Andreas Vlachos

Current automated fact-checking (AFC) approaches commonly evaluate evidence either implicitly via the predicted verdicts or by comparing retrieved evidence with a predefined closed knowledge source, such as Wikipedia.

Fact Checking nlg evaluation +2

TabVer: Tabular Fact Verification with Natural Logic

1 code implementation2 Nov 2024 Rami Aly, Andreas Vlachos

In a few-shot setting on FEVEROUS, we achieve an accuracy of 71. 4, outperforming both fully neural and symbolic reasoning models by 3. 4 points.

Fact Verification

The Automated Verification of Textual Claims (AVeriTeC) Shared Task

1 code implementation31 Oct 2024 Michael Schlichtkrull, Yulong Chen, Chenxi Whitehouse, Zhenyun Deng, Mubashara Akhtar, Rami Aly, Zhijiang Guo, Christos Christodoulopoulos, Oana Cocarascu, Arpit Mittal, James Thorne, Andreas Vlachos

The Automated Verification of Textual Claims (AVeriTeC) shared task asks participants to retrieve evidence and predict veracity for real-world claims checked by fact-checkers.

Conformity in Large Language Models

no code implementations16 Oct 2024 Xiaochen Zhu, Caiqi Zhang, Tom Stafford, Nigel Collier, Andreas Vlachos

Studying this bias in large language models (LLMs) is crucial, as LLMs are increasingly used in various information-seeking and decision-making tasks as conversation partners to improve productivity.

Decision Making

ALVIN: Active Learning Via INterpolation

no code implementations11 Oct 2024 Michalis Korakakis, Andreas Vlachos, Adrian Weller

To address this issue, we propose Active Learning Via INterpolation (ALVIN), which conducts intra-class interpolations between examples from under-represented and well-represented groups to create anchors, i. e., artificial points situated between the example groups in the representation space.

Active Learning Natural Language Inference +2

Zero-Shot Fact Verification via Natural Logic and Large Language Models

1 code implementation4 Oct 2024 Marek Strong, Rami Aly, Andreas Vlachos

To comprehensively assess the zero-shot capabilities of our method and other fact verification systems, we evaluate all models on both artificial and real-world claims, including multilingual datasets.

Fact Verification Zero-shot Generalization

An LLM Feature-based Framework for Dialogue Constructiveness Assessment

1 code implementation20 Jun 2024 Lexin Zhou, Youmna Farag, Andreas Vlachos

In this paper we propose an LLM feature-based framework for dialogue constructiveness assessment that combines the strengths of feature-based and neural approaches, while mitigating their downsides.

Causal Estimation of Memorisation Profiles

1 code implementation6 Jun 2024 Pietro Lesci, Clara Meister, Thomas Hofmann, Andreas Vlachos, Tiago Pimentel

Understanding memorisation in language models has practical and societal implications, e. g., studying models' training dynamics or preventing copyright infringements.

counterfactual Econometrics

Document-level Claim Extraction and Decontextualisation for Fact-Checking

1 code implementation5 Jun 2024 Zhenyun Deng, Michael Schlichtkrull, Andreas Vlachos

Selecting which claims to check is a time-consuming task for human fact-checkers, especially from documents consisting of multiple sentences and containing multiple claims.

Extractive Summarization Fact Checking +2

Automated Focused Feedback Generation for Scientific Writing Assistance

1 code implementation30 May 2024 Eric Chamoun, Michael Schlichktrull, Andreas Vlachos

In this paper, we propose a novel task: automated focused feedback generation for scientific writing assistance.

Reading Comprehension Specificity

AnchorAL: Computationally Efficient Active Learning for Large and Imbalanced Datasets

2 code implementations8 Apr 2024 Pietro Lesci, Andreas Vlachos

By dynamically selecting different anchors at each iteration it promotes class balance and prevents overfitting the initial decision boundary, thus promoting the discovery of new clusters of minority instances.

Active Learning imbalanced classification

PRobELM: Plausibility Ranking Evaluation for Language Models

no code implementations4 Apr 2024 Zhangdie Yuan, Eric Chamoun, Rami Aly, Chenxi Whitehouse, Andreas Vlachos

This paper introduces PRobELM (Plausibility Ranking Evaluation for Language Models), a benchmark designed to assess language models' ability to discern more plausible from less plausible scenarios through their parametric knowledge.

Question Answering TruthfulQA +1

The effect of diversity on group decision-making

1 code implementation2 Feb 2024 Georgi Karadzhov, Andreas Vlachos, Tom Stafford

We explore different aspects of cognitive diversity and its effect on the success of group deliberation.

Decision Making Diversity

Do We Need Language-Specific Fact-Checking Models? The Case of Chinese

no code implementations27 Jan 2024 Caiqi Zhang, Zhijiang Guo, Andreas Vlachos

This paper investigates the potential benefits of language-specific fact-checking models, focusing on the case of Chinese.

Evidence Selection Fact Checking +4

Zero-Shot Fact-Checking with Semantic Triples and Knowledge Graphs

no code implementations19 Dec 2023 Zhangdie Yuan, Andreas Vlachos

Despite progress in automated fact-checking, most systems require a significant amount of labeled training data, which is expensive.

Fact Checking Knowledge Graphs +1

Faster Minimum Bayes Risk Decoding with Confidence-based Pruning

1 code implementation25 Nov 2023 Julius Cheng, Andreas Vlachos

Minimum Bayes risk (MBR) decoding outputs the hypothesis with the highest expected utility over the model distribution for some utility function.

Machine Translation Text Generation

Automated Fact-Checking in Dialogue: Are Specialized Models Needed?

no code implementations14 Nov 2023 Eric Chamoun, Marzieh Saeidi, Andreas Vlachos

Prior research has shown that typical fact-checking models for stand-alone claims struggle with claims made in dialogues.

Fact Checking Retrieval

AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Web

3 code implementations NeurIPS 2023 Michael Schlichtkrull, Zhijiang Guo, Andreas Vlachos

Existing datasets for automated fact-checking have substantial limitations, such as relying on artificial claims, lacking annotations for evidence and intermediate reasoning, or including evidence published after the claim.

Claim Verification Fact Checking +1

Multimodal Automated Fact-Checking: A Survey

1 code implementation22 May 2023 Mubashara Akhtar, Michael Schlichtkrull, Zhijiang Guo, Oana Cocarascu, Elena Simperl, Andreas Vlachos

In this survey, we conceptualise a framework for AFC including subtasks unique to multimodal misinformation.

Fact Checking Misinformation +1

The Intended Uses of Automated Fact-Checking Artefacts: Why, How and Who

1 code implementation27 Apr 2023 Michael Schlichtkrull, Nedjma Ousidhoum, Andreas Vlachos

Automated fact-checking is often presented as an epistemic tool that fact-checkers, social media consumers, and other stakeholders can use to fight misinformation.

Fact Checking Misinformation

Opening up Minds with Argumentative Dialogues

no code implementations16 Jan 2023 Youmna Farag, Charlotte O. Brand, Jacopo Amidei, Paul Piwek, Tom Stafford, Svetlana Stoyanchev, Andreas Vlachos

We show that while both models perform closely in terms of opening up minds, the argument-based model is significantly better on other dialogue properties such as engagement and clarity.

How to disagree well: Investigating the dispute tactics used on Wikipedia

1 code implementation16 Dec 2022 Christine de Kock, Tom Stafford, Andreas Vlachos

Disagreements are frequently studied from the perspective of either detecting toxicity or analysing argument structure.

Natural Logic-guided Autoregressive Multi-hop Document Retrieval for Fact Verification

no code implementations10 Dec 2022 Rami Aly, Andreas Vlachos

We propose a novel retrieve-and-rerank method for multi-hop retrieval, that consists of a retriever that jointly scores documents in the knowledge source and sentences from previously retrieved documents using an autoregressive formulation and is guided by a proof system based on natural logic that dynamically terminates the retrieval process if the evidence is deemed sufficient.

Fact Verification Retrieval

Varifocal Question Generation for Fact-checking

1 code implementation22 Oct 2022 Nedjma Ousidhoum, Zhangdie Yuan, Andreas Vlachos

Our method outperforms previous work on a fact-checking question generation dataset on a wide range of automatic evaluation metrics.

Fact Checking Question Answering +2

Improving Scheduled Sampling with Elastic Weight Consolidation for Neural Machine Translation

no code implementations13 Sep 2021 Michalis Korakakis, Andreas Vlachos

In this paper, we conduct systematic experiments and find that scheduled sampling, while it ameliorates exposure bias by increasing model reliance on the input sequence, worsens performance when the prefix at inference time is correct, a form of catastrophic forgetting.

Machine Translation Translation

Cross-Policy Compliance Detection via Question Answering

no code implementations EMNLP 2021 Marzieh Saeidi, Majid Yazdani, Andreas Vlachos

Policy compliance detection is the task of ensuring that a scenario conforms to a policy (e. g. a claim is valid according to government rules or a post in an online platform conforms to community guidelines).

Natural Language Inference Question Answering +1

A Survey on Automated Fact-Checking

1 code implementation26 Aug 2021 Zhijiang Guo, Michael Schlichtkrull, Andreas Vlachos

Fact-checking has become increasingly important due to the speed with which both information and misinformation can spread in the modern media ecosystem.

Fact Checking Misinformation +1

ProoFVer: Natural Logic Theorem Proving for Fact Verification

1 code implementation25 Aug 2021 Amrith Krishna, Sebastian Riedel, Andreas Vlachos

Fact verification systems typically rely on neural network classifiers for veracity prediction which lack explainability.

Automated Theorem Proving counterfactual +3

DeliData: A dataset for deliberation in multi-party problem solving

no code implementations11 Aug 2021 Georgi Karadzhov, Tom Stafford, Andreas Vlachos

Group deliberation enables people to collaborate and solve problems, however, it is understudied due to a lack of resources.

Problem-Solving Deliberation

Leveraging Type Descriptions for Zero-shot Named Entity Recognition and Classification

no code implementations ACL 2021 Rami Aly, Andreas Vlachos, Ryan Mcdonald

We address the zero-shot NERC specific challenge that the not-an-entity class is not well defined as different entity classes are considered in training and testing.

Machine Reading Comprehension named-entity-recognition +7

FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured information

1 code implementation10 Jun 2021 Rami Aly, Zhijiang Guo, Michael Schlichtkrull, James Thorne, Andreas Vlachos, Christos Christodoulopoulos, Oana Cocarascu, Arpit Mittal

Fact verification has attracted a lot of attention in the machine learning and natural language processing communities, as it is one of the key methods for detecting misinformation.

Fact Verification Misinformation

Evidence-based Factual Error Correction

1 code implementation ACL 2021 James Thorne, Andreas Vlachos

This paper introduces the task of factual error correction: performing edits to a claim so that the generated rewrite is better supported by evidence.

Fact Checking Fact Verification

Web Mining for Estimating Regulatory Blockchain Readiness

no code implementations24 Mar 2021 Elias Iosif, Klitos Christodoulou, Andreas Vlachos

In this work, a computational model is proposed for quantitatively estimating the regulatory stance of countries with respect to cryptocurrencies.

Clustering

Trajectory-Based Meta-Learning for Out-Of-Vocabulary Word Embedding Learning

no code implementations EACL (AdaptNLP) 2021 Gordon Buck, Andreas Vlachos

Word embedding learning methods require a large number of occurrences of a word to accurately learn its embedding.

Meta-Learning

Incremental Beam Manipulation for Natural Language Generation

1 code implementation EACL 2021 James Hargreaves, Andreas Vlachos, Guy Emerson

For this reason, it is common to rerank the output of beam search, but this relies on beam search to produce a good set of hypotheses, which limits the potential gains.

Text Generation

I Beg to Differ: A study of constructive disagreement in online conversations

1 code implementation EACL 2021 Christine de Kock, Andreas Vlachos

We develop a variety of neural models and show that taking into account the structure of the conversation improves predictive accuracy, exceeding that of feature-based models.

A Robust Blockchain Readiness Index Model

no code implementations20 Jan 2021 Elias Iosif, Klitos Christodoulou, Andreas Vlachos

As the blockchain ecosystem gets more mature many businesses, investors, and entrepreneurs are seeking opportunities on working with blockchain systems and cryptocurrencies.

Information Retrieval model +1

Evidence-based Factual Error Correction

3 code implementations31 Dec 2020 James Thorne, Andreas Vlachos

This paper introduces the task of factual error correction: performing edits to a claim so that the generated rewrite is better supported by evidence.

Fact Checking Fact Verification +1

Generating Fact Checking Briefs

no code implementations EMNLP 2020 Angela Fan, Aleksandra Piktus, Fabio Petroni, Guillaume Wenzek, Marzieh Saeidi, Andreas Vlachos, Antoine Bordes, Sebastian Riedel

Fact checking at scale is difficult -- while the number of active fact checking websites is growing, it remains too small for the needs of the contemporary media ecosystem.

Fact Checking Question Answering

Elastic weight consolidation for better bias inoculation

1 code implementation EACL 2021 James Thorne, Andreas Vlachos

The biases present in training datasets have been shown to affect models for sentence pair classification tasks such as natural language inference (NLI) and fact verification.

Fact Verification General Classification +3

Incorporating Label Dependencies in Multilabel Stance Detection

1 code implementation IJCNLP 2019 William Ferreira, Andreas Vlachos

We propose a method that explicitly incorporates label dependencies in the training objective and compare it against a variety of baselines, as well as a reduction of multilabel to multiclass learning.

General Classification Stance Detection

Neural Generative Rhetorical Structure Parsing

no code implementations IJCNLP 2019 Amandla Mabona, Laura Rimell, Stephen Clark, Andreas Vlachos

We show that, for our parser's traversal order, previous beam search algorithms for RNNGs have a left-branching bias which is ill-suited for RST parsing.

Document Classification

Meta-Learning Improves Lifelong Relation Extraction

no code implementations WS 2019 Abiola Obamuyide, Andreas Vlachos

Most existing relation extraction models assume a fixed set of relations and are unable to adapt to exploit newly available supervision data to extract new relations.

Meta-Learning Relation +1

HighRES: Highlight-based Reference-less Evaluation of Summarization

1 code implementation ACL 2019 Hardy, Shashi Narayan, Andreas Vlachos

There has been substantial progress in summarization research enabled by the availability of novel, often large-scale, datasets and recent advances on neural network-based approaches.

Generating Token-Level Explanations for Natural Language Inference

no code implementations NAACL 2019 James Thorne, Andreas Vlachos, Christos Christodoulopoulos, Arpit Mittal

In this paper, we show that it is possible to generate token-level explanations for NLI without the need for training data explicitly annotated for this purpose.

Multiple Instance Learning Natural Language Inference +2

Automated Fact Checking in the News Room

no code implementations3 Apr 2019 Sebastião Miranda, David Nogueira, Afonso Mendes, Andreas Vlachos, Andrew Secker, Rebecca Garrett, Jeff Mitchel, Zita Marinho

Fact checking is an essential task in journalism; its importance has been highlighted due to recently increased concerns and efforts in combating misinformation.

Fact Checking Misinformation

Adversarial attacks against Fact Extraction and VERification

no code implementations13 Mar 2019 James Thorne, Andreas Vlachos

This paper describes a baseline for the second iteration of the Fact Extraction and VERification shared task (FEVER2. 0) which explores the resilience of systems through adversarial evaluation.

Fact Checking Information Retrieval +2

Guided Neural Language Generation for Abstractive Summarization using Abstract Meaning Representation

1 code implementation EMNLP 2018 Hardy, Andreas Vlachos

In this paper, we extend previous work on abstractive summarization using Abstract Meaning Representation (AMR) with a neural language generation stage which we guide using the source document.

Abstractive Text Summarization Abstract Meaning Representation +2

Topic or Style? Exploring the Most Useful Features for Authorship Attribution

1 code implementation COLING 2018 Yunita Sari, Mark Stevenson, Andreas Vlachos

Approaches to authorship attribution, the task of identifying the author of a document, are based on analysis of individuals{'} writing style and/or preferred topics.

Authorship Attribution Text Categorization

Automated Fact Checking: Task formulations, methods and future directions

no code implementations COLING 2018 James Thorne, Andreas Vlachos

The recently increased focus on misinformation has stimulated research in fact checking, the task of assessing the truthfulness of a claim.

Fact Checking Misinformation

FEVER: a large-scale dataset for Fact Extraction and VERification

5 code implementations NAACL 2018 James Thorne, Andreas Vlachos, Christos Christodoulopoulos, Arpit Mittal

Thus we believe that FEVER is a challenging testbed that will help stimulate progress on claim verification against textual sources.

Claim Verification Sentence

Sheffield at SemEval-2017 Task 9: Transition-based language generation from AMR.

no code implementations SEMEVAL 2017 Gerasimos Lampouras, Andreas Vlachos

This paper describes the submission by the University of Sheffield to the SemEval 2017 Abstract Meaning Representation Parsing and Generation task (SemEval 2017 Task 9, Subtask 2).

Abstract Meaning Representation Language Modeling +3

An Extensible Framework for Verification of Numerical Claims

no code implementations EACL 2017 James Thorne, Andreas Vlachos

In this paper we present our automated fact checking system demonstration which we developed in order to participate in the Fast and Furious Fact Check challenge.

Fact Checking Rumour Detection +1

Imitation learning for structured prediction in natural language processing

no code implementations EACL 2017 Andreas Vlachos, Gerasimos Lampouras, Sebastian Riedel

Imitation learning is a learning paradigm originally developed to learn robotic controllers from demonstrations by humans, e. g. autonomous flight from pilot demonstrations.

coreference-resolution Dependency Parsing +5

Stance Detection with Bidirectional Conditional Encoding

1 code implementation EMNLP 2016 Isabelle Augenstein, Tim Rocktäschel, Andreas Vlachos, Kalina Bontcheva

Stance detection is the task of classifying the attitude expressed in a text towards a target such as Hillary Clinton to be "positive", negative" or "neutral".

Stance Detection

Cannot find the paper you are looking for? You can Submit a new open access paper.