Search Results for author:
Found 6 papers, 5 papers with code
Using Text Injection to Improve Recognition of Personal Identifiers in Speech
We use text-injection to improve the recognition of PII categories by including fake textual substitutes of PII categories in the training data using a text injection method.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Measuring the Robustness of NLP Models to Domain Shifts
Our benchmark focuses on natural topical domain shifts and enables measuring both the SD and the TD.
TrueTeacher: Learning Factual Consistency Evaluation with Large Language Models
Factual consistency evaluation is often conducted using Natural Language Inference (NLI) models, yet these models exhibit limited success in evaluating summaries.
On the Robustness of Dialogue History Representation in Conversational Question Answering: A Comprehensive Study and a New Prompt-based Method
We find that high benchmark scores do not necessarily translate to strong robustness, and that various methods can perform extremely differently under different settings.
RED-ACE: Robust Error Detection for ASR using Confidence Embeddings
ASR Error Detection (AED) models aim to post-process the output of Automatic Speech Recognition (ASR) systems, in order to detect transcription errors.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
KoBE: Knowledge-Based Machine Translation Evaluation
Our approach achieves the highest correlation with human judgements on 9 out of the 18 language pairs from the WMT19 benchmark for evaluation without references, which is the largest number of wins for a single evaluation method on this task.
