Search Results for author: Dan Tufiş

Found 7 papers, 2 papers with code

Towards Improving the Performance of Pre-Trained Speech Models for Low-Resource Languages Through Lateral Inhibition

no code implementations30 Jun 2023 Andrei-Marius Avram, Răzvan-Alexandru Smădu, Vasile Păiş, Dumitru-Clementin Cercel, Radu Ion, Dan Tufiş

With the rise of bidirectional encoder representations from Transformer models in natural language processing, the speech community has adopted some of their development methodologies.

Distilling the Knowledge of Romanian BERTs Using Multiple Teachers

1 code implementation LREC 2022 Andrei-Marius Avram, Darius Catrina, Dumitru-Clementin Cercel, Mihai Dascălu, Traian Rebedea, Vasile Păiş, Dan Tufiş

In this work, we introduce three light and fast versions of distilled BERT models for the Romanian language: Distil-BERT-base-ro, Distil-RoBERT-base, and DistilMulti-BERT-base-ro.

Dialect Identification Knowledge Distillation +9

Romanian Speech Recognition Experiments from the ROBIN Project

1 code implementation23 Nov 2021 Andrei-Marius Avram, Vasile Păiş, Dan Tufiş

One of the fundamental functionalities for accepting a socially assistive robot is its communication capabilities with other agents in the environment.

Language Modelling speech-recognition +1

More Romanian word embeddings from the RETEROM project

no code implementations21 Nov 2021 Vasile Păiş, Dan Tufiş

To this end, the previously created sets of word embeddings (based on word occurrences) on the CoRoLa corpus (P\u{a}i\c{s} and Tufi\c{s}, 2018) are and will be further augmented with new representations learned from the same corpus by using specific features such as lemmas and parts of speech.

LEMMA Word Embeddings

Capitalization and Punctuation Restoration: a Survey

no code implementations21 Nov 2021 Vasile Păiş, Dan Tufiş

Ensuring proper punctuation and letter casing is a key pre-processing step towards applying complex natural language processing algorithms.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +2

Cannot find the paper you are looking for? You can Submit a new open access paper.