Search Results for author:
Found 38 papers, 5 papers with code
German-Arabic Speech-to-Speech Translation for Psychiatric Diagnosis
As this is a very specific domain, in addition to the linguistic challenges posed by translating between Arabic and German, we also focus in this paper on the methods we implemented for adapting our speech translation system to the domain of this psychiatric interview.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+6
Audio Segmentation for Robust Real-Time Speech Recognition Based on Neural Networks
Speech that contains multimedia content can pose a serious challenge for real-time automatic speech recognition (ASR) for two reasons: (1) The ASR produces meaningless output, hurting the readability of the transcript.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Integrating Encyclopedic Knowledge into Neural Language Models
Neural models have recently shown big improvements in the performance of phrase-based machine translation.
The IWSLT 2019 KIT Speech Translation System
This paper describes KIT’s submission to the IWSLT 2019 Speech Translation task on two sub-tasks corresponding to two different datasets.
Family of Origin and Family of Choice: Massively Parallel Lexiconized Iterative Pretraining for Severely Low Resource Text-based Translation
In other words, given a text in 124 source languages, we translate it into a severely low resource language using only ∼1, 000 lines of low resource data without any external help.
Effective combination of pretrained models - KIT@IWSLT2022
Pretrained models in acoustic and textual modalities can potentially improve speech translation for both Cascade and End-to-end approaches.
Supervised Adaptation of Sequence-to-Sequence Speech Recognition Systems using Batch-Weighting
This problem is even bigger for end-to-end speech recognition systems that only accept transcribed speech as training data, which is harder and more expensive to obtain than text data.
FINDINGS OF THE IWSLT 2021 EVALUATION CAMPAIGN
The evaluation campaign of the International Conference on Spoken Language Translation (IWSLT 2021) featured this year four shared tasks: (i) Simultaneous speech translation, (ii) Offline speech translation, (iii) Multilingual speech translation, (iv) Low-resource speech translation.
Multilingual Speech Translation KIT @ IWSLT2021
This paper contains the description for the submission of Karlsruhe Institute of Technology (KIT) for the multilingual TEDx translation task in the IWSLT 2021 evaluation campaign.
Findings of the IWSLT 2022 Evaluation Campaign
The evaluation campaign of the 19th International Conference on Spoken Language Translation featured eight shared tasks: (i) Simultaneous speech translation, (ii) Offline speech translation, (iii) Speech to speech translation, (iv) Low-resource speech translation, (v) Multilingual speech translation, (vi) Dialect speech translation, (vii) Formality control for speech translation, (viii) Isometric speech translation.
KIT’s Multilingual Neural Machine Translation systems for IWSLT 2017
For the SLT track, in addition to a monolingual neural translation system used to generate correct punctuations and true cases of the data prior to training our multilingual system, we introduced a noise model in order to make our system more robust.
Machine Translation from Standard German to Alemannic Dialects
There, improvements range from 7. 5 to 10. 6 BLEU points over the baseline depending on the dialect.
Incorporating External Annotation to improve Named Entity Translation in NMT
The correct translation of named entities (NEs) still poses a challenge for conventional neural machine translation (NMT) systems.
From Text Segmentation to Smart Chaptering: A Novel Benchmark for Structuring Video Transcriptions
Text segmentation is a fundamental task in natural language processing, where documents are split into contiguous sections.
Ranked #1 on
Headline Generation
on YTSeg
Continuously Learning New Words in Automatic Speech Recognition
Despite recent advances, Automatic Speech Recognition (ASR) systems are still far from perfect.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Convoifilter: A case study of doing cocktail party speech recognition
The model utilizes a single-channel speech enhancement module that isolates the speaker's voice from background noise (ConVoiFilter) and an ASR module.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
End-to-End Evaluation for Low-Latency Simultaneous Speech Translation
Secondly, we compare different approaches to low-latency speech translation using this framework.
Audio-driven Talking Face Generation by Overcoming Unintended Information Flow
Specifically, this involves unintended flow of lip, pose and other information from the reference to the generated image, as well as instabilities during model training.
KIT's Multilingual Speech Translation System for IWSLT 2023
In this paper, we describe our speech translation system for the multilingual track of IWSLT 2023, which evaluates translation quality on scientific conference talks.
Towards continually learning new languages
Multilingual speech recognition with neural networks is often implemented with batch-learning, when all of the languages are available before training.
A Survey on Computer Vision based Human Analysis in the COVID-19 Era
The emergence of COVID-19 has had a global and profound impact, not only on society as a whole, but also on the lives of individuals.
Language-agnostic Code-Switching in Sequence-To-Sequence Speech Recognition
Code-Switching (CS) is referred to the phenomenon of alternately using words and phrases from different languages.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+3
Code-Switching without Switching: Language Agnostic End-to-End Speech Translation
We propose a) a Language Agnostic end-to-end Speech Translation model (LAST), and b) a data augmentation strategy to increase code-switching (CS) performance.
Face-Dubbing++: Lip-Synchronous, Voice Preserving Translation of Videos
The system is designed to combine multiple component models and produces a video of the original speaker speaking in the target language that is lip-synchronous with the target speech, yet maintains emphases in speech, voice characteristics, face video of the original speaker.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+6
Exposure Correction Model to Enhance Image Quality
We show that after applying exposure correction with the proposed model, the portrait matting quality increases significantly.
CUNI-KIT System for Simultaneous Speech Translation Task at IWSLT 2022
In this paper, we describe our submission to the Simultaneous Speech Translation at IWSLT 2022.
Short-Term Word-Learning in a Dynamically Changing Environment
In this paper we study, a) methods to acquire important words for this memory dynamically and, b) the trade-off between improvement in recognition accuracy of new words and the potential danger of false alarms for those added words.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Instant One-Shot Word-Learning for Context-Specific Neural Sequence-to-Sequence Speech Recognition
To alleviate this problem we supplement an end-to-end ASR system with a word/phrase memory and a mechanism to access this memory to recognize the words and phrases correctly.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Alpha Matte Generation from Single Input for Portrait Matting
We first generate a coarse segmentation map from the input image and then predict the alpha matte by utilizing the image and segmentation map.
Efficient Weight factorization for Multilingual Speech Recognition
The key idea of the method is to assign fast weight matrices for each language by decomposing each weight matrix into a shared component and a language dependent component.
CAGAN: Text-To-Image Generation with Combined Attention GANs
Generating images according to natural language descriptions is a challenging task.
Unconstrained Face-Mask & Face-Hand Datasets: Building a Computer Vision System to Help Prevent the Transmission of COVID-19
To train and evaluate the developed system, we collected and annotated images that represent face mask usage and face-hand interaction in the real world.
Unsupervised Transfer Learning in Multilingual Neural Machine Translation with Cross-Lingual Word Embeddings
In an attempt to train the mapping from the encoder sentence representation to a new target language we use our model as an autoencoder.
Gun Source and Muzzle Head Detection
We have interesting results both in bounding the shooter as well as detecting the gun smoke.
Very Deep Self-Attention Networks for End-to-End Speech Recognition
Recently, end-to-end sequence-to-sequence models for speech recognition have gained significant interest in the research community.
Effective Strategies in Zero-Shot Neural Machine Translation
In this paper, we proposed two strategies which can be applied to a multilingual neural machine translation system in order to better tackle zero-shot scenarios despite not having any parallel corpus.
Toward Multilingual Neural Machine Translation with Universal Encoder and Decoder
In this paper, we present our first attempts in building a multilingual Neural Machine Translation framework under a unified approach.
