Search Results for author: Viktor Schlegel

Found 28 papers, 12 papers with code

‘Am I the Bad One’? Predicting the Moral Judgement of the Crowd Using Pre–trained Language Models

no code implementations LREC 2022 Areej Alhassan, Jinkai Zhang, Viktor Schlegel

This paper studies whether state-of-the-art, pre-trained language models are capable of passing moral judgments on posts retrieved from a popular Reddit user board.

Anomaly Detection Natural Language Inference

Incorporating Zoning Information into Argument Mining from Biomedical Literature

no code implementations LREC 2022 Boyang Liu, Viktor Schlegel, Riza Batista-Navarro, Sophia Ananiadou

Argumentative zoning, a specific text zoning scheme for the scientific domain, is considered as the antecedent for argument mining by many researchers.

Argument Mining Sentence

Learning to Generate and Evaluate Fact-checking Explanations with Transformers

no code implementations21 Oct 2024 Darius Feher, Abdullah Khered, Hao Zhang, Riza Batista-Navarro, Viktor Schlegel

By introducing human-centred evaluation methods and developing specialised datasets, we emphasise the need for aligning Artificial Intelligence (AI)-generated explanations with human judgements.

Fact Checking Hallucination +2

Seemingly Plausible Distractors in Multi-Hop Reasoning: Are Large Language Models Attentive Readers?

1 code implementation8 Sep 2024 Neeladri Bhuiya, Viktor Schlegel, Stefan Winkler

State-of-the-art Large Language Models (LLMs) are accredited with an increasing number of different capabilities, ranging from reading comprehension, over advanced mathematical and reasoning skills to possessing scientific knowledge.

Language Modelling Reading Comprehension

MEDSAGE: Enhancing Robustness of Medical Dialogue Summarization to ASR Errors with LLM-generated Synthetic Dialogues

no code implementations26 Aug 2024 Kuluhan Binici, Abhinav Ramesh Kashyap, Viktor Schlegel, Andy T. Liu, Vijay Prakash Dwivedi, Thanh-Tung Nguyen, Xiaoxue Gao, Nancy F. Chen, Stefan Winkler

Experimental results show that LLMs can effectively model ASR noise, and incorporating this noisy data into the training process significantly improves the robustness and accuracy of medical dialogue summarization systems.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +3

LLMs are not Zero-Shot Reasoners for Biomedical Information Extraction

no code implementations22 Aug 2024 Aishik Nagar, Viktor Schlegel, Thanh-Tung Nguyen, Hao Li, Yuping Wu, Kuluhan Binici, Stefan Winkler

Large Language Models (LLMs) are increasingly adopted for applications in healthcare, reaching the performance of domain experts on tasks such as question answering and document summarisation.

named-entity-recognition Named Entity Recognition +3

Investigating a Benchmark for Training-set free Evaluation of Linguistic Capabilities in Machine Reading Comprehension

no code implementations9 Aug 2024 Viktor Schlegel, Goran Nenadic, Riza Batista-Navarro

Performance of NLP systems is typically evaluated by collecting a large-scale dataset by means of crowd-sourcing to train a data-driven model and evaluate it on a held-out portion of the data.

Diversity Language Modelling +1

Which Side Are You On? A Multi-task Dataset for End-to-End Argument Summarisation and Evaluation

2 code implementations5 Jun 2024 Hao Li, Yuping Wu, Viktor Schlegel, Riza Batista-Navarro, Tharindu Madusanka, Iqra Zahid, Jiayan Zeng, Xiaochi Wang, Xinran He, Yizhi Li, Goran Nenadic

In our work, we introduce an argument mining dataset that captures the end-to-end process of preparing an argumentative essay for a debate, which covers the tasks of claim and evidence identification (Task 1 ED), evidence convincingness ranking (Task 2 ECR), argumentative essay summarisation and human preference ranking (Task 3 ASR) and metric learning for automated evaluation of resulting essays, based on human feedback along argument quality dimensions (Task 4 SQE).

Argument Mining Metric Learning +1

A Two-Stage Decoder for Efficient ICD Coding

1 code implementation27 May 2023 Thanh-Tung Nguyen, Viktor Schlegel, Abhinav Kashyap, Stefan Winkler

Clinical notes in healthcare facilities are tagged with the International Classification of Diseases (ICD) code; a list of classification codes for medical diagnoses and procedures.

Decoder Multilabel Text Classification +2

Do You Hear The People Sing? Key Point Analysis via Iterative Clustering and Abstractive Summarisation

1 code implementation25 May 2023 Hao Li, Viktor Schlegel, Riza Batista-Navarro, Goran Nenadic

Furthermore, evaluating key points is crucial in ensuring that the automatically generated summaries are useful.

Sentence

Towards Human-Centred Explainability Benchmarks For Text Classification

no code implementations10 Nov 2022 Viktor Schlegel, Erick Mendez-Guzman, Riza Batista-Navarro

Progress on many Natural Language Processing (NLP) tasks, such as text classification, is driven by objective, reproducible and scalable evaluation via publicly available benchmarks.

Misinformation Position +4

Can Transformers Reason in Fragments of Natural Language?

1 code implementation10 Nov 2022 Viktor Schlegel, Kamen V. Pavlov, Ian Pratt-Hartmann

State-of-the-art deep-learning-based approaches to Natural Language Processing (NLP) are credited with various capabilities that involve reasoning with natural language texts.

valid

RaFoLa: A Rationale-Annotated Corpus for Detecting Indicators of Forced Labour

no code implementations LREC 2022 Erick Mendez Guzman, Viktor Schlegel, Riza Batista-Navarro

Each news article was annotated for two aspects: (1) indicators of forced labour as classification labels and (2) snippets of the text that justify labelling decisions.

Multi Label Text Classification Multi-Label Text Classification +1

WLASL-LEX: a Dataset for Recognising Phonological Properties in American Sign Language

no code implementations ACL 2022 Federico Tavella, Viktor Schlegel, Marta Romeo, Aphrodite Galata, Angelo Cangelosi

Signed Language Processing (SLP) concerns the automated processing of signed languages, the main means of communication of Deaf and hearing impaired individuals.

Translation

Semantics Altering Modifications for Evaluating Comprehension in Machine Reading

1 code implementation7 Dec 2020 Viktor Schlegel, Goran Nenadic, Riza Batista-Navarro

Advances in NLP have yielded impressive results for the task of machine reading comprehension (MRC), with approaches having been reported to achieve performance comparable to that of humans.

Machine Reading Comprehension Sentence

Beyond Leaderboards: A survey of methods for revealing weaknesses in Natural Language Inference data and models

no code implementations29 May 2020 Viktor Schlegel, Goran Nenadic, Riza Batista-Navarro

Recent years have seen a growing number of publications that analyse Natural Language Inference (NLI) datasets for superficial cues, whether they undermine the complexity of the tasks underlying those datasets and how they impact those models that are optimised and evaluated on this data.

Natural Language Inference

Identifying Supporting Facts for Multi-hop Question Answering with Document Graph Networks

no code implementations WS 2019 Mokanarangan Thayaparan, Marco Valentino, Viktor Schlegel, Andre Freitas

Recent advances in reading comprehension have resulted in models that surpass human performance when the answer is contained in a single, continuous passage of text.

Multi-hop Question Answering Question Answering +1

Cannot find the paper you are looking for? You can Submit a new open access paper.