Search Results for author: Valerio Basile

Found 34 papers, 6 papers with code

We Need to Consider Disagreement in Evaluation

no code implementations ACL (BPPF) 2021 Valerio Basile, Michael Fell, Tommaso Fornaciari, Dirk Hovy, Silviu Paun, Barbara Plank, Massimo Poesio, Alexandra Uma

Instead, we suggest that we need to better capture the sources of disagreement to improve today’s evaluation practice.

Italian NLP for Everyone: Resources and Models from EVALITA to the European Language Grid

no code implementations LREC 2022 Valerio Basile, Cristina Bosco, Michael Fell, Viviana Patti, Rossella Varvara

The European Language Grid enables researchers and practitioners to easily distribute and use NLP resources and models, such as corpora and classifiers.

Counter-TWIT: An Italian Corpus for Online Counterspeech in Ecological Contexts

no code implementations NAACL (WOAH) 2022 Pierpaolo Goffredo, Valerio Basile, Biancamaria Cepollaro, Viviana Patti

This work describes the process of creating a corpus of Twitter conversations annotated for the presence of counterspeech in response to toxic speech related to axes of discrimination linked to sexism, racism and homophobia.

Counterspeech Detection

Litescale: A Lightweight Tool for Best-worst Scaling Annotation

no code implementations RANLP 2021 Valerio Basile, Christian Cagnazzo

Best-worst Scaling (BWS) is a methodology for annotation based on comparing and ranking instances, rather than classifying or scoring individual instances.

Capturing Perspectives of Crowdsourced Annotators in Subjective Learning Tasks

1 code implementation16 Nov 2023 Negar Mokhberian, Myrl G. Marmarelis, Frederic R. Hopp, Valerio Basile, Fred Morstatter, Kristina Lerman

Previous studies have shed light on the pitfalls of label aggregation and have introduced a handful of practical approaches to tackle this issue.

Classification Fairness

SemEval-2023 Task 11: Learning With Disagreements (LeWiDi)

no code implementations28 Apr 2023 Elisa Leonardelli, Alexandra Uma, Gavin Abercrombie, Dina Almanea, Valerio Basile, Tommaso Fornaciari, Barbara Plank, Verena Rieser, Massimo Poesio

We report on the second LeWiDi shared task, which differs from the first edition in three crucial respects: (i) it focuses entirely on NLP, instead of both NLP and computer vision tasks in its first edition; (ii) it focuses on subjective tasks, instead of covering different types of disagreements-as training with aggregated labels for subjective NLP tasks is a particularly obvious misrepresentation of the data; and (iii) for the evaluation, we concentrate on soft approaches to evaluation.

Sentiment Analysis

APPReddit: a Corpus of Reddit Posts Annotated for Appraisal

no code implementations LREC 2022 Marco Antonio Stranisci, Simona Frenda, Eleonora Ceccaldi, Valerio Basile, Rossana Damiano, Viviana Patti

Despite the large number of computational resources for emotion recognition, there is a lack of data sets relying on appraisal models.

Emotion Recognition

Local Multi-Head Channel Self-Attention for Facial Expression Recognition

1 code implementation14 Nov 2021 Roberto Pecoraro, Valerio Basile, Viviana Bono, Sara Gallo

Since the Transformer architecture was introduced in 2017 there has been many attempts to bring the self-attention paradigm in the field of computer vision.

Ranked #6 on Facial Expression Recognition (FER) on FER2013 (using extra training data)

Facial Expression Recognition Facial Expression Recognition (FER)

Toward a Perspectivist Turn in Ground Truthing for Predictive Computing

no code implementations9 Sep 2021 Valerio Basile, Federico Cabitza, Andrea Campagner, Michael Fell

Most Artificial Intelligence applications are based on supervised machine learning (ML), which ultimately grounds on manually annotated data.

Decision Making

Whose Opinions Matter? Perspective-aware Models to Identify Opinions of Hate Speech Victims in Abusive Language Detection

no code implementations30 Jun 2021 Sohail Akhtar, Valerio Basile, Viviana Patti

Therefore, we need novel approaches to model conflicting perspectives and opinions coming from people with different personal and demographic backgrounds.

Abusive Language Cultural Vocal Bursts Intensity Prediction

Multilingual Irony Detection with Dependency Syntax and Neural Models

1 code implementation COLING 2020 Alessandra Teresa Cignarella, Valerio Basile, Manuela Sanguinetti, Cristina Bosco, Paolo Rosso, Farah Benamara

This paper presents an in-depth investigation of the effectiveness of dependency-based syntactic features on the irony detection task in a multilingual perspective (English, Spanish, French and Italian).

Word Embeddings

Do You Really Want to Hurt Me? Predicting Abusive Swearing in Social Media

no code implementations LREC 2020 Endang Wahyu Pamungkas, Valerio Basile, Viviana Patti

In this study, we explore the phenomenon of swearing in Twitter conversations, taking the possibility of predicting the abusiveness of a swear word in a tweet context as the main investigation perspective.

SemEval-2019 Task 5: Multilingual Detection of Hate Speech Against Immigrants and Women in Twitter

no code implementations SEMEVAL 2019 Valerio Basile, Cristina Bosco, Elisabetta Fersini, Debora Nozza, Viviana Patti, Francisco Manuel Rangel Pardo, Paolo Rosso, Manuela Sanguinetti

The paper describes the organization of the SemEval 2019 Task 5 about the detection of hate speech against immigrants and women in Spanish and English messages extracted from Twitter.

Stance Classification for Rumour Analysis in Twitter: Exploiting Affective Information and Conversation Structure

1 code implementation7 Jan 2019 Endang Wahyu Pamungkas, Valerio Basile, Viviana Patti

On this line, a new shared task has been proposed at SemEval-2017 (Task 8, SubTask A), which is focused on rumour stance classification in English tweets.

Classification General Classification +3

The DipInfo-UniTo system for SRST 2018

no code implementations WS 2018 Valerio Basile, Aless Mazzei, ro

This paper describes the system developed by the DipInfo-UniTo team to participate to the shallow track of the Surface Realization Shared Task 2018.

Morphological Inflection Text Generation

Measuring Frame Instance Relatedness

no code implementations SEMEVAL 2018 Valerio Basile, Roque Lopez Condori, Elena Cabrio

Frame semantics is a well-established framework to represent the meaning of natural language in computational terms.

Clustering Reading Comprehension +4

Empirical Analysis of Foundational Distinctions in Linked Open Data

1 code implementation26 Mar 2018 Luigi Asprino, Valerio Basile, Paolo Ciancarini, Valentina Presutti

For example, distinctions such as whether an entity is inherently a class or an individual, or whether it is a physical object or not, are hardly expressed in the data, although they have been largely studied and formalised by foundational ontologies (e. g. DOLCE, SUMO).

Common Sense Reasoning Natural Language Understanding +1

Developing a large semantically annotated corpus

no code implementations LREC 2012 Valerio Basile, Johan Bos, Kilian Evang, Noortje Venhuizen

What would be a good method to provide a large collection of semantically annotated texts with formal, deep semantics rather than shallow?

Boundary Detection Part-Of-Speech Tagging

Cannot find the paper you are looking for? You can Submit a new open access paper.