no code implementations • EMNLP (FEVER) 2021 • Rami Aly, Zhijiang Guo, Michael Sejr Schlichtkrull, James Thorne, Andreas Vlachos, Christos Christodoulopoulos, Oana Cocarascu, Arpit Mittal
The Fact Extraction and VERification Over Unstructured and Structured information (FEVEROUS) shared task, asks participating systems to determine whether human-authored claims are Supported or Refuted based on evidence retrieved from Wikipedia (or NotEnoughInfo if the claim cannot be verified).
1 code implementation • COLING 2022 • Siffi Singh, Alham Fikri Aji, Gaurav Singh, Christos Christodoulopoulos
Most datasets are constructed using synthetic tables that lack valuable metadata information, or are limited in size to be considered as a challenging evaluation set.
no code implementations • EMNLP 2020 • Joseph Fisher, Arpit Mittal, Dave Palfrey, Christos Christodoulopoulos
It has been shown that knowledge graph embeddings encode potentially harmful social biases, such as the information that women are more likely to be nurses, and men more likely to be bankers.
1 code implementation • 31 Oct 2024 • Michael Schlichtkrull, Yulong Chen, Chenxi Whitehouse, Zhenyun Deng, Mubashara Akhtar, Rami Aly, Zhijiang Guo, Christos Christodoulopoulos, Oana Cocarascu, Arpit Mittal, James Thorne, Andreas Vlachos
The Automated Verification of Textual Claims (AVeriTeC) shared task asks participants to retrieve evidence and predict veracity for real-world claims checked by fact-checkers.
no code implementations • 23 May 2023 • Chenxi Whitehouse, Clara Vania, Alham Fikri Aji, Christos Christodoulopoulos, Andrea Pierleoni
We evaluate the in-domain, out-of-domain, and zero-shot cross-lingual performance of generative IE models and find models trained on WebIE show better generalisability.
no code implementations • 6 Oct 2022 • Dieuwke Hupkes, Mario Giulianelli, Verna Dankers, Mikel Artetxe, Yanai Elazar, Tiago Pimentel, Christos Christodoulopoulos, Karim Lasri, Naomi Saphra, Arabella Sinclair, Dennis Ulmer, Florian Schottmann, Khuyagbaatar Batsuren, Kaiser Sun, Koustuv Sinha, Leila Khalatbari, Maria Ryskina, Rita Frieske, Ryan Cotterell, Zhijing Jin
We present a taxonomy for characterising and understanding generalisation research in NLP.
3 code implementations • NAACL (ACL) 2022 • Tom Ayoola, Shubhi Tyagi, Joseph Fisher, Christos Christodoulopoulos, Andrea Pierleoni
The model is capable of generalising to large-scale knowledge bases such as Wikidata (which has 15 times more entities than Wikipedia) and of zero-shot entity linking.
Ranked #1 on Entity Linking on WebQSP-WD (using extra training data)
no code implementations • 10 Dec 2021 • Mingwen Dong, Christos Christodoulopoulos, Sheng-Min Shih, Xiaofei Ma
A BERT-based retrieval model made more mistakes in retrieving refuting evidence for false claims than supporting evidence for true claims.
1 code implementation • 10 Jun 2021 • Rami Aly, Zhijiang Guo, Michael Schlichtkrull, James Thorne, Andreas Vlachos, Christos Christodoulopoulos, Oana Cocarascu, Arpit Mittal
Fact verification has attracted a lot of attention in the machine learning and natural language processing communities, as it is one of the key methods for detecting misinformation.
no code implementations • EACL 2021 • Xiang Zhou, Heba Elfardy, Christos Christodoulopoulos, Thomas Butler, Mohit Bansal
Using the observations and experimental results, we provide practical suggestions on how to create more reliable datasets for the unreliable news detection task.
no code implementations • 5 Dec 2019 • Joseph Fisher, Dave Palfrey, Christos Christodoulopoulos, Arpit Mittal
It has recently been shown that word embeddings encode social biases, with a harmful impact on downstream tasks.
no code implementations • IJCNLP 2019 • James Thorne, Andreas Vlachos, Christos Christodoulopoulos, Arpit Mittal
Automated fact verification has been progressing owing to advancements in modeling and availability of large datasets.
no code implementations • WS 2019 • James Thorne, Andreas Vlachos, Oana Cocarascu, Christos Christodoulopoulos, Arpit Mittal
We present the results of the second Fact Extraction and VERification (FEVER2. 0) Shared Task.
no code implementations • NAACL 2019 • James Thorne, Andreas Vlachos, Christos Christodoulopoulos, Arpit Mittal
In this paper, we show that it is possible to generate token-level explanations for NLI without the need for training data explicitly annotated for this purpose.
no code implementations • WS 2018 • James Thorne, Andreas Vlachos, Oana Cocarascu, Christos Christodoulopoulos, Arpit Mittal
We present the results of the first Fact Extraction and VERification (FEVER) Shared Task.
1 code implementation • COLING 2018 • Lori Moon, Christos Christodoulopoulos, Cynthia Fisher, S. Franco, ra, Dan Roth
Inter-annotator agreement is given separately for prepositions and verbs, and for adult speech and child speech.
no code implementations • COLING 2018 • Christos Christodoulopoulos
Finally, I will present the Fact Extraction and VERification (FEVER) dataset and challenge.
1 code implementation • LREC 2018 • Daniel Khashabi, Mark Sammons, Ben Zhou, Tom Redman, Christos Christodoulopoulos, Vivek Srikumar, Nicholas Rizzolo, Lev Ratinov, Guanheng Luo, Quang Do, Chen-Tse Tsai, Subhro Roy, Stephen Mayhew, Zhili Feng, John Wieting, Xiaodong Yu, Yangqiu Song, Shashank Gupta, Shyam Upadhyay, Naveen Arivazhagan, Qiang Ning, Shaoshi Ling, Dan Roth
no code implementations • LREC 2018 • Christos Christodoulopoulos, Arpit Mittal
Knowledge-based question answering relies on the availability of facts, the majority of which cannot be found in structured sources (e. g. Wikipedia info-boxes, Wikidata).
5 code implementations • NAACL 2018 • James Thorne, Andreas Vlachos, Christos Christodoulopoulos, Arpit Mittal
Thus we believe that FEVER is a challenging testbed that will help stimulate progress on claim verification against textual sources.
no code implementations • 25 Jul 2017 • Parisa Kordjamshidi, Sameer Singh, Daniel Khashabi, Christos Christodoulopoulos, Mark Summons, Saurabh Sinha, Dan Roth
In particular, we provide an initial prototype for a relational and graph traversal query language where queries are directly used as relational features for structured machine learning models.
1 code implementation • COLING 2016 • Parisa Kordjamshidi, Daniel Khashabi, Christos Christodoulopoulos, Bhargav Mangipudi, Sameer Singh, Dan Roth
We present a novel way for designing complex joint inference and learning models using Saul (Kordjamshidi et al., 2015), a recently-introduced declarative learning-based programming language (DeLBP).
no code implementations • COLING 2016 • Shyam Upadhyay, Nitish Gupta, Christos Christodoulopoulos, Dan Roth
Cross document event coreference (CDEC) is an important task that aims at aggregating event-related information across multiple documents.
no code implementations • 14 Sep 2016 • Stephen Mayhew, Christos Christodoulopoulos, Dan Roth
We introduce a method for transliteration generation that can produce transliterations in every language.
no code implementations • LREC 2016 • Mark Sammons, Christos Christodoulopoulos, Parisa Kordjamshidi, Daniel Khashabi, Vivek Srikumar, Dan Roth
We present EDISON, a Java library of feature generation functions used in a suite of state-of-the-art NLP tools, based on a set of generic NLP data structures.