1 code implementation • NoDaLiDa 2021 • Petter Mæhlum, Jeremy Barnes, Robin Kurtz, Lilja Øvrelid, Erik Velldal
This paper introduces NorecNeg – the first annotated dataset of negation for Norwegian.
no code implementations • SemEval (NAACL) 2022 • Jeremy Barnes, Laura Oberlaender, Enrica Troiano, Andrey Kutuzov, Jan Buchmann, Rodrigo Agerri, Lilja Øvrelid, Erik Velldal
In this paper, we introduce the first SemEval shared task on Structured Sentiment Analysis, for which participants are required to predict all sentiment graphs in a text, where a single sentiment graph is composed of a sentiment holder, target, expression and polarity.
2 code implementations • WS (NoDaLiDa) 2019 • Jeremy Barnes, Samia Touileb, Lilja Øvrelid, Erik Velldal
This paper explores the use of multi-task learning (MTL) for incorporating external knowledge in neural models.
1 code implementation • WS (NoDaLiDa) 2019 • Petter Mæhlum, Jeremy Barnes, Lilja Øvrelid, Erik Velldal
This paper documents the creation of a large-scale dataset of evaluative sentences – i. e. both subjective and objective sentences that are found to be sentiment-bearing – based on mixed-domain professional reviews from various news-sources.
no code implementations • 21 Mar 2025 • Jeremy Barnes, Naiara Perez, Alba Bonet-Jover, Begoña Altuna
Through our new dataset BASSE (BAsque and Spanish Summarization Evaluation), we address this situation by collecting human judgments on 2, 040 abstractive summaries in Basque and Spanish, generated either manually or by five LLMs with four different prompts.
no code implementations • 27 Feb 2025 • Karolina Stańczak, Nicholas Meade, Mehar Bhatia, Hattie Zhou, Konstantin Böttinger, Jeremy Barnes, Jason Stanley, Jessica Montgomery, Richard Zemel, Nicolas Papernot, Nicolas Chapados, Denis Therien, Timothy P. Lillicrap, Ana Marasović, Sylvie Delacroix, Gillian K. Hadfield, Siva Reddy
Recent progress in large language models (LLMs) has focused on producing responses that meet human expectations and align with shared values - a process coined alignment.
1 code implementation • 18 Feb 2025 • Maite Heredia, Gorka Labaka, Jeremy Barnes, Aitor Soroa
Code-switching (CS) is still a critical challenge in Natural Language Processing (NLP).
no code implementations • 13 Feb 2025 • Blanca Calvo Figueras, Eneko Sagarzazu, Julen Etxaniz, Jeremy Barnes, Pablo Gamallo, Iria De Dios Flores, Rodrigo Agerri
We introduce a professionally translated extension of the TruthfulQA benchmark designed to evaluate truthfulness in Basque, Catalan, Galician, and Spanish.
no code implementations • 13 Dec 2024 • Jaione Bengoetxea, Mikel Zubillaga, Ekhi Azurmendi, Maite Heredia, Julen Etxaniz, Markel Ferro, Jeremy Barnes
For Intent Detection and Slot Filling, we have fine-tuned a multitask model in a cross-lingual setting, to leverage the xSID dataset available in 17 languages.
1 code implementation • 10 Apr 2024 • Maite Heredia, Julen Etxaniz, Muitze Zulaika, Xabier Saralegi, Jeremy Barnes, Aitor Soroa
We have conducted a series of experiments using mono- and multilingual LLMs to assess a) the effect of professional post-edition on the MT system; b) the best cross-lingual strategy for NLI in Basque; and c) whether the choice of the best cross-lingual strategy is influenced by the fact that the dataset is built by translation.
Natural Language Inference
Natural Language Understanding
+1
no code implementations • 5 Feb 2024 • Patrick Bareiß, Roman Klinger, Jeremy Barnes
This is particularly of interest when we have access to a multilingual large language model, because we could request labels with English prompts even for non-English data.
no code implementations • VarDial (COLING) 2022 • Petter Mæhlum, Andre Kåsen, Samia Touileb, Jeremy Barnes
We show that models trained on Universal Dependency (UD) data perform worse when evaluated against this dataset, and that models trained on Bokm{\aa}l generally perform better than those trained on Nynorsk.
1 code implementation • ACL 2022 • David Samuel, Jeremy Barnes, Robin Kurtz, Stephan Oepen, Lilja Øvrelid, Erik Velldal
This paper demonstrates how a graph-based semantic parser can be applied to the task of structured sentiment analysis, directly predicting sentiment graphs from text.
no code implementations • ACL 2021 • Antonio Mart{\'\i}nez-Garc{\'\i}a, Toni Badia, Jeremy Barnes
Furthermore, POS tagging is more sensitive to morphological typology than sentiment analysis and, on this task, models perform much better on fusional languages than on the other typologies.
2 code implementations • ACL 2021 • Jeremy Barnes, Robin Kurtz, Stephan Oepen, Lilja Øvrelid, Erik Velldal
Structured sentiment analysis attempts to extract full opinion tuples from a text, but over time this task has been subdivided into smaller and smaller sub-tasks, e, g,, target extraction or targeted polarity classification.
1 code implementation • Findings (ACL) 2021 • Samia Touileb, Jeremy Barnes
However, the interplay between language similarity and difference in script on cross-lingual transfer is a less studied problem.
1 code implementation • ACL 2021 • Pierre Lison, Jeremy Barnes, Aliaksandr Hubin
skweak is especially designed to facilitate the use of weak supervision for NLP tasks such as text classification and sequence labelling.
2 code implementations • NoDaLiDa 2021 • Andrey Kutuzov, Jeremy Barnes, Erik Velldal, Lilja Øvrelid, Stephan Oepen
We present the ongoing NorLM initiative to support the creation and use of very large contextualised language models for Norwegian (and in principle other Nordic languages), including a ready-to-use software environment, as well as an experience report for data preparation and training.
1 code implementation • NoDaLiDa 2021 • Jeremy Barnes, Petter Mæhlum, Samia Touileb
Norway has a large amount of dialectal variation, as well as a general tolerance to its use in the public sphere.
no code implementations • EACL 2021 • Jeremy Barnes, Lilja Øvrelid, Erik Velldal
Fine-grained sentiment analysis attempts to extract sentiment holders, targets and polar expressions and resolve the relationship between them, but progress has been hampered by the difficulty of annotation.
2 code implementations • NAACL 2021 • Andrew Moore, Jeremy Barnes
The majority of work in targeted sentiment analysis has concentrated on finding better methods to improve the overall results.
1 code implementation • ACL 2020 • Pierre Lison, Aliaksandr Hubin, Jeremy Barnes, Samia Touileb
When in-domain labelled data is available, transfer learning techniques can be used to adapt existing NER models to the target domain.
2 code implementations • COLING (PEOPLES) 2020 • Irean Navas Alejo, Toni Badia, Jeremy Barnes
Consequently, we explore cross-lingual transfer approaches for fine-grained emotion detection in Spanish and Catalan tweets.
1 code implementation • 19 Feb 2020 • Jeremy Barnes, Vinit Ravishankar, Lilja Øvrelid, Erik Velldal
Documents are composed of smaller pieces - paragraphs, sentences, and tokens - that have complex relationships between one another.
1 code implementation • LREC 2020 • Lilja Øvrelid, Petter Mæhlum, Jeremy Barnes, Erik Velldal
We introduce NoReC_fine, a dataset for fine-grained sentiment analysis in Norwegian, annotated with respect to polar expressions, targets and holders of opinion.
1 code implementation • 24 Jun 2019 • Jeremy Barnes, Roman Klinger
As expected, the choice of annotated source language for projection to a target leads to better results for source-target language pairs which are similar.
no code implementations • 18 Jun 2019 • Jeremy Barnes
This paper details LTG-Oslo team's participation in the sentiment track of the NEGES 2019 evaluation campaign.
1 code implementation • 18 Jun 2019 • Jeremy Barnes, Erik Velldal, Lilja Øvrelid
Sentiment analysis is directly affected by compositional phenomena in language that act on the prior polarity of the words and phrases found in the text.
no code implementations • 13 Jun 2019 • Àlex R. Atrio, Toni Badia, Jeremy Barnes
Current state-of-the-art models for sentiment analysis make use of word order either explicitly by pre-training on a language modeling objective or implicitly by using recurrent neural networks (RNNs) or convolutional networks (CNNs).
Cross-Lingual Sentiment Classification
General Classification
+5
1 code implementation • WS 2019 • Jeremy Barnes, Lilja Øvrelid, Erik Velldal
Finally, we provide a case study that demonstrates the usefulness of the dataset to probe the performance of a given sentiment classifier with respect to linguistic phenomena.
no code implementations • WS 2019 • {\c{C}}a{\u{g}}r{\i} {\c{C}}{\"o}ltekin, Jeremy Barnes
This paper describes T{\"u}bingen-Oslo team{'}s participation in the cross-lingual morphological analysis task in the VarDial 2019 evaluation campaign.
1 code implementation • COLING 2018 • Jeremy Barnes, Roman Klinger, Sabine Schulte im Walde
Our analysis shows that our model performs comparably to state-of-the-art approaches on domains that are similar, while performing significantly better on highly divergent domains.
1 code implementation • 12 Jun 2018 • Jeremy Barnes, Roman Klinger, Sabine Schulte im Walde
Our analysis shows that our model performs comparably to state-of-the-art approaches on domains that are similar, while performing significantly better on highly divergent domains.
1 code implementation • ACL 2018 • Jeremy Barnes, Roman Klinger, Sabine Schulte im Walde
Sentiment analysis in low-resource languages suffers from a lack of annotated corpora to estimate high-performing models.
Cross-Lingual Sentiment Classification
Machine Translation
+5
no code implementations • LREC 2018 • Jeremy Barnes, Patrik Lambert, Toni Badia
While sentiment analysis has become an established field in the NLP community, research into languages other than English has been hindered by the lack of resources.
no code implementations • WS 2017 • Jeremy Barnes, Roman Klinger, Sabine Schulte im Walde
We show that Bi-LSTMs perform well across datasets and that both LSTMs and Bi-LSTMs are particularly good at fine-grained sentiment tasks (i. e., with more than two classes).
no code implementations • WS 2017 • Hendrik Schuff, Jeremy Barnes, Julian Mohme, Sebastian Pad{\'o}, Roman Klinger
There is a rich variety of data sets for sentiment analysis (viz., polarity and subjectivity classification).
no code implementations • COLING 2016 • Jeremy Barnes, Patrik Lambert, Toni Badia
Cross-lingual sentiment classification (CLSC) seeks to use resources from a source language in order to detect sentiment and classify text in a target language.