Search Results for author:
Found 42 papers, 20 papers with code
Train, Sort, Explain: Learning to Diagnose Translation Models
Evaluating translation models is a trade-off between effort and detail.
Subjective Assessment of Text Complexity: A Dataset for German Language
This paper presents TextComplexityDE, a dataset consisting of 1000 sentences in German language taken from 23 Wikipedia articles in 3 different article-genres to be used for developing text-complexity predictor models and automatic text simplification in German language.
Untrue.News: A New Search Engine For Fake Stories
In this paper, we demonstrate Untrue News, a new search engine for fake stories.
Impact of the Number of Votes on the Reliability and Validity of Subjective Speech Quality Assessment in the Crowdsourcing Approach
The subjective quality of transmitted speech is traditionally assessed in a controlled laboratory environment according to ITU-T Rec.
Multimedia
Towards Deep Learning Methods for Quality Assessment of Computer-Generated Imagery
Video gaming streaming services are growing rapidly due to new services such as passive video streaming, e. g. Twitch. tv, and cloud gaming, e. g. Nvidia Geforce Now.
From Witch's Shot to Music Making Bones -- Resources for Medical Laymen to Technical Language and Vice Versa
This also applies to information about a person's health status.
Evaluating German Transformer Language Models with Syntactic Agreement Tests
Most of the studies were conducted for the English language, however.
Fine-grained linguistic evaluation for state-of-the-art Machine Translation
This paper describes a test suite submission providing detailed statistics of linguistic performance for the state-of-the-art German-English systems of the Fifth Conference of Machine Translation (WMT20).
Incorporating Wireless Communication Parameters into the E-Model Algorithm
However, the NB, WB, and FB E-model algorithms do not consider wireless techniques used in these networks, such as Multiple-Input-Multiple-Output (MIMO) systems, which are used to improve the communication system robustness in the presence of different types of wireless channel degradation.
Efficient Explanations from Empirical Explainers
Amid a discussion about Green AI in which we see explainability neglected, we explore the possibility to efficiently approximate computationally expensive explainers.
NISQA: A Deep CNN-Self-Attention Model for Multidimensional Speech Quality Prediction with Crowdsourced Datasets
In this paper, we present an update to the NISQA speech quality prediction model that is focused on distortions that occur in communication networks.
Bias-Aware Loss for Training Image and Speech Quality Prediction Models from Multiple Datasets
The ground truth used for training image, video, or speech quality prediction models is based on the Mean Opinion Scores (MOS) obtained from subjective experiments.
Deep Learning Based Assessment of Synthetic Speech Naturalness
Further, we show that the reliability of deep learning-based naturalness prediction can be improved by transfer learning from speech quality prediction models that are trained on objective POLQA scores.
Full-Reference Speech Quality Estimation with Attentional Siamese Neural Networks
In this paper, we present a full-reference speech quality prediction model with a deep learning approach.
Towards Human-Free Automatic Quality Evaluation of German Summarization
Evaluating large summarization corpora using humans has proven to be expensive from both the organizational and the financial perspective.
Thermostat: A Large Collection of NLP Model Explanations and Analysis Tools
To facilitate research, we present Thermostat which consists of a large collection of model explanations and accompanying analysis tools.
A Feature Extraction based Model for Hate Speech Identification
This paper presents TU Berlin team experiments and results on the task 1A and 1B of the shared task on hate speech and offensive content identification in Indo-European languages 2021.
MuLVE, A Multi-Language Vocabulary Evaluation Data Set
Vocabulary learning is vital to foreign language learning.
When Performance is not Enough -- A Multidisciplinary View on Clinical Decision Support
Scientific publications about machine learning in healthcare are often about implementing novel methods and boosting the performance - at least from a computer science perspective.
Mediators: Conversational Agents Explaining NLP Model Behavior
The human-centric explainable artificial intelligence (HCXAI) community has raised the need for framing the explanation process as a conversation between human and machine.
A Medical Information Extraction Workbench to Process German Clinical Text
However, in the context of clinical text processing the number of accessible datasets is scarce -- and so is the number of existing tools.
A Transfer Learning Based Model for Text Readability Assessment in German
Text readability assessment has a wide range of applications for different target people, from language learners to people with disabilities.
Cross-lingual Approaches for the Detection of Adverse Drug Reactions in German from a Patient's Perspective
In this work, we present the first corpus for German Adverse Drug Reaction (ADR) detection in patient-generated content.
Saliency Map Verbalization: Comparing Feature Importance Representations from Model-free and Instruction-based Methods
Saliency maps can explain a neural model's predictions by identifying important input features.
MultiTACRED: A Multilingual Version of the TAC Relation Extraction Dataset
Relation extraction (RE) is a fundamental task in information extraction, whose extension to multilingual settings has been hindered by the lack of supervised resources comparable in size to large English datasets such as TACRED (Zhang et al., 2017).
InterroLang: Exploring NLP Models and Datasets through Dialogue-based Explanations
While recently developed NLP explainability methods let us open the black box in various ways (Madsen et al., 2022), a missing ingredient in this endeavor is an interactive tool offering a conversational interface.
LLMCheckup: Conversational Examination of Large Language Models via Interpretability Tools
Interpretability tools that offer explanations in the form of a dialogue have demonstrated their efficacy in enhancing users' understanding, as one-off explanations may occasionally fall short in providing sufficient information to the user.
Protect and Extend -- Using GANs for Synthetic Data Generation of Time-Series Medical Records
Preservation of private user data is of paramount importance for high Quality of Experience (QoE) and acceptability, particularly with services treating sensitive data, such as IT-based health services.
A Dataset for Pharmacovigilance in German, French, and Japanese: Annotating Adverse Drug Reactions across Languages
User-generated data sources have gained significance in uncovering Adverse Drug Reactions (ADRs), with an increasing number of discussions occurring in the digital world.
Towards Personality-Aware Chatbots
Chatbots are increasingly used to automate operational processes in customer service.
Simulating Turn-Taking in Conversations with Delayed Transmission
We show how the turn-taking mechanisms modeled for conversations without delay perform in scenarios with delay and identify to which extend the simulation is able to model the delayed turn-taking observed in human conversation.
Linguistic Evaluation for the 2021 State-of-the-art Machine Translation Systems for German to English and English to German
We are using a semi-automated test suite in order to provide a fine-grained linguistic evaluation for state-of-the-art machine translation systems.
Reliability of Human Evaluation for Text Summarization: Lessons Learned and Challenges Ahead
Based on our empirical analysis, we provide guidelines to ensure the reliability of expert and non-expert evaluations, and we determine the factors that might affect the reliability of the human evaluation.
Best Practices for Crowd-based Evaluation of German Summarization: Comparing Crowd, Expert and Automatic Evaluation
On the one hand, the human assessment of summarization quality conducted by linguistic experts is slow, expensive, and still not a standardized procedure.
Overview of the GermEval 2022 Shared Task on Text Complexity Assessment of German Text
We designed the task as text regression in which participants developed models to predict complexity of pieces of text for a German learner in a range from 1 to 7.
Subjective Text Complexity Assessment for German
In order to provide suitable text for the target audience, it is necessary to measure its complexity.
A Linguistically Motivated Test Suite to Semi-Automatically Evaluate German–English Machine Translation Output
Furthermore, we present various exemplary applications of our test suite that have been implemented in the past years, like contributions to the Conference of Machine Translation, the usage of the test suite and MT outputs for quality estimation, and the expansion of the test suite to the language pair Portuguese–English.
Using Neural Machine Translation Methods for Sign Language Translation
We examine methods and techniques, proven to be helpful for the text-to-text translation of spoken languages in the context of gloss-to-text translation systems, where the glosses are the written representation of the signs.
Towards Hybrid Human-Machine Workflow for Natural Language Generation
In recent years, crowdsourcing has gained much attention from researchers to generate data for the Natural Language Generation (NLG) tools or to evaluate them.
Cross-lingual Approaches for the Detection of Adverse Drug Reactions in German from a Patient’s Perspective
In this work, we present the first corpus for German Adverse Drug Reaction (ADR) detection in patient-generated content.
Claim extraction from text using transfer learning.
Building an end to end fake news detection system consists of detecting claims in text and later verifying them for their authenticity.
Perceptual Quality Dimensions of Machine-Generated Text with a Focus on Machine Translation
The quality of machine-generated text is a complex construct consisting of various aspects and dimensions.
