Search Results for author: Anastasiia Sedova

Found 7 papers, 6 papers with code

To Know or Not To Know? Analyzing Self-Consistency of Large Language Models under Ambiguity

1 code implementation24 Jul 2024 Anastasiia Sedova, Robert Litschko, Diego Frassinelli, Benjamin Roth, Barbara Plank

This paper focuses on entity type ambiguity, analyzing the proficiency and consistency of state-of-the-art LLMs in applying factual knowledge when prompted with ambiguous entities.

Analysing zero-shot temporal relation extraction on clinical notes using temporal consistency

1 code implementation17 Jun 2024 Vasiliki Kougia, Anastasiia Sedova, Andreas Stephan, Klim Zaporojets, Benjamin Roth

Our experiments demonstrate that LLMs struggle in the zero-shot setting performing worse than fine-tuned specialized models in terms of F1 score, showing that this is a challenging task for LLMs.

Relation Temporal Relation Extraction

Exploring prompts to elicit memorization in masked language model-based named entity recognition

no code implementations5 May 2024 Yuxi Xia, Anastasiia Sedova, Pedro Henrique Luz de Araujo, Vasiliki Kougia, Lisa Nußbaumer, Benjamin Roth

Finally, the prompt performance of detecting model memorization is quantified by the percentage of name pairs for which the model has higher confidence for the name from the training set.

Language Modeling Language Modelling +4

Learning with Noisy Labels by Adaptive Gradient-Based Outlier Removal

1 code implementation7 Jun 2023 Anastasiia Sedova, Lena Zellinger, Benjamin Roth

Instead of cleaning the dataset prior to model training, the dataset is dynamically adjusted during the training process.

Denoising Learning with noisy labels

ACTC: Active Threshold Calibration for Cold-Start Knowledge Graph Completion

1 code implementation10 May 2023 Anastasiia Sedova, Benjamin Roth

In this paper, we attempt for the first time cold-start calibration for KGC, where no annotated examples exist initially for calibration, and only a limited number of tuples can be selected for annotation.

Knowledge Graph Completion Relation

ULF: Unsupervised Labeling Function Correction using Cross-Validation for Weak Supervision

1 code implementation14 Apr 2022 Anastasiia Sedova, Benjamin Roth

A cost-effective alternative to manual data labeling is weak supervision (WS), where data samples are automatically annotated using a predefined set of labeling functions (LFs), rule-based mechanisms that generate artificial labels for the associated classes.

Denoising Weakly-supervised Learning

Knodle: Modular Weakly Supervised Learning with PyTorch

1 code implementation ACL (RepL4NLP) 2021 Anastasiia Sedova, Andreas Stephan, Marina Speranskaya, Benjamin Roth

Strategies for improving the training and prediction quality of weakly supervised machine learning models vary in how much they are tailored to a specific task or integrated with a specific model architecture.

Benchmarking BIG-bench Machine Learning +3

Cannot find the paper you are looking for? You can Submit a new open access paper.