Search Results for author:
Found 22 papers, 9 papers with code
Maastricht University’s Large-Scale Multilingual Machine Translation System for WMT 2021
We present our development of the multilingual machine translation system for the large-scale multilingual machine translation task at WMT 2021.
Maastricht University’s Multilingual Speech Translation System for IWSLT 2021
The task in this track is to build multilingual speech translation systems in supervised and zero-shot directions.
Effective combination of pretrained models - KIT@IWSLT2022
Pretrained models in acoustic and textual modalities can potentially improve speech translation for both Cascade and End-to-end approaches.
How do Multimodal Foundation Models Encode Text and Speech? An Analysis of Cross-Lingual and Cross-Modal Representations
Multimodal foundation models aim to create a unified representation space that abstracts away from surface features like language syntax or modality differences.
Optimizing Rare Word Accuracy in Direct Speech Translation with a Retrieval-and-Demonstration Approach
To leverage these valuable resources, we propose a retrieval-and-demonstration approach to enhance rare word translation accuracy in direct ST models.
Speech Editing -- a Summary
With the rise of video production and social media, speech editing has become crucial for creators to address issues like mispronunciations, missing words, or stuttering in audio recordings.
Blending LLMs into Cascaded Speech Translation: KIT's Offline Speech Translation System for IWSLT 2024
Firstly, we refine the ASR outputs by utilizing the N-best lists generated by our system and fine-tuning the LLM to predict the transcript accurately.
SciEx: Benchmarking Large Language Models on Scientific Exams with Human Expert Grading and Automatic Grading
We evaluate the performance of various state-of-the-art LLMs on our new benchmark.
Language-Independent Representations Improve Zero-Shot Summarization
In this work, we focus on summarization and tackle the problem through the lens of language-independent representations.
How Transferable are Attribute Controllers on Pretrained Multilingual Translation Models?
This gap is out of sync with recent progress in pretrained massively multilingual translation models.
End-to-End Evaluation for Low-Latency Simultaneous Speech Translation
Secondly, we compare different approaches to low-latency speech translation using this framework.
KIT's Multilingual Speech Translation System for IWSLT 2023
In this paper, we describe our speech translation system for the multilingual track of IWSLT 2023, which evaluates translation quality on scientific conference talks.
Learning an Artificial Language for Knowledge-Sharing in Multilingual Translation
In this work, we discretize the encoder output latent space of multilingual models by assigning encoder states to entries in a codebook, which in effect represents source sentences in a new artificial language.
CUNI-KIT System for Simultaneous Speech Translation Task at IWSLT 2022
In this paper, we describe our submission to the Simultaneous Speech Translation at IWSLT 2022.
Tackling data scarcity in speech translation using zero-shot multilingual machine translation techniques
We investigate whether these ideas can be applied to speech translation, by building ST models trained on speech transcription and text translation data.
Cost-Effective Training in Low-Resource Neural Machine Translation
Although AL is shown to be helpful with large budgets, it is not enough to build high-quality translation systems in these low-resource conditions.
From Start to Finish: Latency Reduction Strategies for Incremental Speech Synthesis in Simultaneous Speech-to-Speech Translation
Speech-to-speech translation (S2ST) converts input speech to speech in another language.
Data Augmentation
Simultaneous Speech-to-Speech Translation
+4
Direct Simultaneous Speech-to-Speech Translation with Variational Monotonic Multihead Attention
We present a direct simultaneous speech-to-speech translation (Simul-S2ST) model, Furthermore, the generation of translation is independent from intermediate text representations.
Simultaneous Speech-to-Speech Translation
Speech Synthesis
+2
Unsupervised Machine Translation On Dravidian Languages
We show that unifying the writing systems is essential in unsupervised translation between the Dravidian languages.
Improving Zero-Shot Translation by Disentangling Positional Information
The difficulty of generalizing to new translation directions suggests the model representations are highly specific to those language pairs seen in training.
Adapting End-to-End Speech Recognition for Readable Subtitles
The experiments show that with limited data far less than needed for training a model from scratch, we can adapt a Transformer-based ASR model to incorporate both transcription and compression capabilities.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Low-Latency Sequence-to-Sequence Speech Recognition and Translation by Partial Hypothesis Selection
On How2 English-Portuguese speech translation, we reduce latency to 0. 7 second (-84% rel.)
