Search Results for author: Alessio Miaschi

Found 8 papers, 2 papers with code

How Do BERT Embeddings Organize Linguistic Knowledge?

no code implementations NAACL (DeeLIO) 2021 Giovanni Puccetti, Alessio Miaschi, Felice Dell’Orletta

Several studies investigated the linguistic information implicitly encoded in Neural Language Models.

What Makes My Model Perplexed? A Linguistic Investigation on Neural Language Models Perplexity

no code implementations NAACL (DeeLIO) 2021 Alessio Miaschi, Dominique Brunato, Felice Dell’Orletta, Giulia Venturi

This paper presents an investigation aimed at studying how the linguistic structure of a sentence affects the perplexity of two of the most popular Neural Language Models (NLMs), BERT and GPT-2.

A dissemination workshop for introducing young Italian students to NLP

1 code implementation NAACL (TeachingNLP) 2021 Lucio Messina, Lucia Busso, Claudia Roberta Combei, Ludovica Pannitto, Alessio Miaschi, Gabriele Sarti, Malvina Nissim

We describe and make available the game-based material developed for a laboratory run at several Italian science festivals to popularize NLP among young students.

Teaching NLP with Bracelets and Restaurant Menus: An Interactive Workshop for Italian Students

1 code implementation NAACL (TeachingNLP) 2021 Ludovica Pannitto, Lucia Busso, Claudia Roberta Combei, Lucio Messina, Alessio Miaschi, Gabriele Sarti, Malvina Nissim

To raise awareness, curiosity, and longer-term interest in young people, we have developed an interactive workshop designed to illustrate the basic principles of NLP and computational linguistics to high school Italian students aged between 13 and 18 years.

Natural Language Processing

Linguistic Profiling of a Neural Language Model

no code implementations COLING 2020 Alessio Miaschi, Dominique Brunato, Felice Dell'Orletta, Giulia Venturi

In this paper we investigate the linguistic knowledge learned by a Neural Language Model (NLM) before and after a fine-tuning process and how this knowledge affects its predictions during several classification problems.

Language Modelling

Contextual and Non-Contextual Word Embeddings: an in-depth Linguistic Investigation

no code implementations WS 2020 Alessio Miaschi, Felice Dell{'}Orletta

In this paper we present a comparison between the linguistic knowledge encoded in the internal representations of a contextual Language Model (BERT) and a contextual-independent one (Word2vec).

Language Modelling Word Embeddings

Tracking the Evolution of Written Language Competence in L2 Spanish Learners

no code implementations WS 2020 Alessio Miaschi, Sam Davidson, Dominique Brunato, Felice Dell{'}Orletta, Kenji Sagae, Claudia Helena Sanchez-Gutierrez, Giulia Venturi

In this paper we present an NLP-based approach for tracking the evolution of written language competence in L2 Spanish learners using a wide range of linguistic features automatically extracted from students{'} written productions.

Linguistically-Driven Strategy for Concept Prerequisites Learning on Italian

no code implementations WS 2019 Alessio Miaschi, Chiara Alzetta, Franco Alberto Cardillo, Felice Dell{'}Orletta

We present a new concept prerequisite learning method for Learning Object (LO) ordering that exploits only linguistic features extracted from textual educational resources.

Cannot find the paper you are looking for? You can Submit a new open access paper.