no code implementations • NAACL (DeeLIO) 2021 • Alessio Miaschi, Dominique Brunato, Felice Dell’Orletta, Giulia Venturi
This paper presents an investigation aimed at studying how the linguistic structure of a sentence affects the perplexity of two of the most popular Neural Language Models (NLMs), BERT and GPT-2.
no code implementations • NAACL (DeeLIO) 2021 • Giovanni Puccetti, Alessio Miaschi, Felice Dell’Orletta
Several studies investigated the linguistic information implicitly encoded in Neural Language Models.
1 code implementation • 27 Feb 2024 • Alessio Miaschi, Felice Dell'Orletta, Giulia Venturi
In this paper, we explore the impact of augmenting pre-trained Encoder-Decoder models, specifically T5, with linguistic knowledge for the prediction of a target task.
1 code implementation • NAACL (TeachingNLP) 2021 • Ludovica Pannitto, Lucia Busso, Claudia Roberta Combei, Lucio Messina, Alessio Miaschi, Gabriele Sarti, Malvina Nissim
To raise awareness, curiosity, and longer-term interest in young people, we have developed an interactive workshop designed to illustrate the basic principles of NLP and computational linguistics to high school Italian students aged between 13 and 18 years.
1 code implementation • NAACL (TeachingNLP) 2021 • Lucio Messina, Lucia Busso, Claudia Roberta Combei, Ludovica Pannitto, Alessio Miaschi, Gabriele Sarti, Malvina Nissim
We describe and make available the game-based material developed for a laboratory run at several Italian science festivals to popularize NLP among young students.
no code implementations • COLING 2020 • Alessio Miaschi, Dominique Brunato, Felice Dell'Orletta, Giulia Venturi
In this paper we investigate the linguistic knowledge learned by a Neural Language Model (NLM) before and after a fine-tuning process and how this knowledge affects its predictions during several classification problems.
no code implementations • WS 2020 • Alessio Miaschi, Sam Davidson, Dominique Brunato, Felice Dell{'}Orletta, Kenji Sagae, Claudia Helena Sanchez-Gutierrez, Giulia Venturi
In this paper we present an NLP-based approach for tracking the evolution of written language competence in L2 Spanish learners using a wide range of linguistic features automatically extracted from students{'} written productions.
no code implementations • WS 2020 • Alessio Miaschi, Felice Dell{'}Orletta
In this paper we present a comparison between the linguistic knowledge encoded in the internal representations of a contextual Language Model (BERT) and a contextual-independent one (Word2vec).
no code implementations • WS 2019 • Alessio Miaschi, Chiara Alzetta, Franco Alberto Cardillo, Felice Dell{'}Orletta
We present a new concept prerequisite learning method for Learning Object (LO) ordering that exploits only linguistic features extracted from textual educational resources.