Search Results for author:
Found 25 papers, 4 papers with code
HeLI-OTS, Off-the-shelf Language Identifier for Text
This paper introduces HeLI-OTS, an off-the-shelf text language identification tool using the HeLI language identification method.
Experiments in Language Variety Geolocation and Dialect Identification
In this paper we describe the systems we used when participating in the VarDial Evaluation Campaign organized as part of the 7th workshop on NLP for similar languages, varieties and dialects.
Uralic Language Identification (ULI) 2020 shared task dataset and the Wanca 2017 corpora
This article introduces the Wanca 2017 web corpora from which the sentences written in minor Uralic languages were collected for the test set of the Uralic Language Identification (ULI) 2020 shared task.
A Report on the VarDial Evaluation Campaign 2020
This paper presents the results of the VarDial Evaluation Campaign 2020 organized as part of the seventh workshop on Natural Language Processing (NLP) for Similar Languages, Varieties and Dialects (VarDial), co-located with COLING 2020.
Findings of the VarDial Evaluation Campaign 2021
This paper describes the results of the shared tasks organized as part of the VarDial Evaluation Campaign 2021.
Italian Language and Dialect Identification and Regional French Variety Detection using Adaptive Naive Bayes
This article describes the language identification approach used by the SUKI team in the Identification of Languages and Dialects of Italy and the French Cross-Domain Dialect Identification shared tasks organized as part of the VarDial workshop 2022.
Naive Bayes-based Experiments in Romanian Dialect Identification
This article describes the experiments and systems developed by the SUKI team for the second edition of the Romanian Dialect Identification (RDI) shared task which was organized as part of the 2021 VarDial Evaluation Campaign.
Findings of the VarDial Evaluation Campaign 2023
This report presents the results of the shared tasks organized as part of the VarDial Evaluation Campaign 2023.
Language Variety Identification with True Labels
Research has shown that this is a problematic assumption, particularly in the case of very similar languages (e. g., Croatian and Serbian) and national language varieties (e. g., Brazilian and European Portuguese), where texts may contain no distinctive marker of the particular language or variety.
Comparing Approaches to Dravidian Language Identification
This paper describes the submissions by team HWR to the Dravidian Language Identification (DLI) shared task organized at VarDial 2021 workshop.
FinnSentiment -- A Finnish Social Media Corpus for Sentiment Polarity Annotation
Sentiment analysis and opinion mining is an important task with obvious application areas in social media, e. g. when indicating hate speech and fake news.
Uralic Language Identification (ULI) 2020 shared task dataset and the Wanca 2017 corpus
This article introduces the Wanca 2017 corpus of texts crawled from the internet from which the sentences in rare Uralic languages for the use of the Uralic Language Identification (ULI) 2020 shared task were collected.
Building Web Corpora for Minority Languages
Web corpora creation for minority languages that do not have their own top-level Internet domain is no trivial matter.
Discriminating between Mandarin Chinese and Swiss-German varieties using adaptive language models
This paper describes the language identification systems used by the SUKI team in the Discriminating between the Mainland and Taiwan variation of Mandarin Chinese (DMT) and the German Dialect Identification (GDI) shared tasks which were held as part of the third VarDial Evaluation Campaign.
A Report on the Third VarDial Evaluation Campaign
In this paper, we present the findings of the Third VarDial Evaluation Campaign organized as part of the sixth edition of the workshop on Natural Language Processing (NLP) for Similar Languages, Varieties and Dialects (VarDial), co-located with NAACL 2019.
Language Model Adaptation for Language and Dialect Identification of Text
This article describes an unsupervised language model adaptation approach that can be used to enhance the performance of language identification methods.
Language and Dialect Identification of Cuneiform Texts
This article introduces a corpus of cuneiform texts from which the dataset for the use of the Cuneiform Language Identification (CLI) 2019 shared task was derived as well as some preliminary language identification experiments conducted using that corpus.
HeLI-based Experiments in Swiss German Dialect Identification
In this paper we present the experiments and results by the SUKI team in the German Dialect Identification shared task of the VarDial 2018 Evaluation Campaign.
Iterative Language Model Adaptation for Indo-Aryan Language Identification
This paper presents the experiments and results obtained by the SUKI team in the Indo-Aryan Language Identification shared task of the VarDial 2018 Evaluation Campaign.
HeLI-based Experiments in Discriminating Between Dutch and Flemish Subtitles
This paper presents the experiments and results obtained by the SUKI team in the Discriminating between Dutch and Flemish in Subtitles shared task of the VarDial 2018 Evaluation Campaign.
Automatic Language Identification in Texts: A Survey
Language identification (LI) is the problem of determining the natural language that a document or part thereof is written in.
Evaluating HeLI with Non-Linear Mappings
In this paper we describe the non-linear mappings we used with the Helsinki language identification method, HeLI, in the 4th edition of the Discriminating between Similar Languages (DSL) shared task, which was organized as part of the VarDial 2017 workshop.
HeLI, a Word-Based Backoff Method for Language Identification
The shared task comprised of a total of 8 tracks, of which we participated in 7.
