Search Results for author:
Found 46 papers, 13 papers with code
Decoding Word Embeddings with Brain-Based Semantic Features
For each probing task, we identify the most relevant semantic features and we show that there is a correlation between the embedding performance and how they encode those features.
Pragmatic and Logical Inferences in NLI Systems: The Case of Conjunction Buttressing
An intelligent system is expected to perform reasonable inferences, accounting for both the literal meaning of a word and the meanings a word can acquire in different contexts.
The CogALex Shared Task on Monolingual and Multilingual Identification of Semantic Relations
One containing pairs for each of the training languages (systems were evaluated in a monolingual fashion) and the other proposing a surprise language to test the crosslingual transfer capabilities of the systems.
AILAB-Udine@SMM4H’22: Limits of Transformers and BERT Ensembles
This paper describes the models developed by the AILAB-Udine team for the SMM4H’22 Shared Task.
Evaluating Monolingual and Crosslingual Embeddings on Datasets of Word Association Norms
In free word association tasks, human subjects are presented with a stimulus word and are then asked to name the first word (the response word) that comes up to their mind.
Discovering Financial Hypernyms by Prompting Masked Language Models
With the rising popularity of Transformer-based language models, several studies have tried to exploit their masked language modeling capabilities to automatically extract relational linguistic knowledge, although this kind of research has rarely investigated semantic relations in specialized domains.
Lexicon of Changes: Towards the Evaluation of Diachronic Semantic Shift in Chinese
Recent research has brought a wind of using computational approaches to the classic topic of semantic change, aiming to tackle one of the most challenging issues in the evolution of human language.
CMCL 2022 Shared Task on Multilingual and Crosslingual Prediction of Human Reading Behavior
We present the second shared task on eye-tracking data prediction of the Cognitive Modeling and Computational Linguistics Workshop (CMCL).
Looking for a Role for Word Embeddings in Eye-Tracking Features Prediction: Does Semantic Similarity Help?
Eye-tracking psycholinguistic studies have suggested that context-word semantic coherence and predictability influence language processing during the reading activity.
CMCL 2021 Shared Task on Eye-Tracking Prediction
The goal of the task is to predict 5 different token- level eye-tracking metrics of the Zurich Cognitive Language Processing Corpus (ZuCo).
Is Domain Adaptation Worth Your Investment? Comparing BERT and FinBERT on Financial Tasks
With the recent rise in popularity of Transformer models in Natural Language Processing, research efforts have been dedicated to the development of domain-adapted versions of BERT-like architectures.
Composing or Not Composing? Towards Distributional Construction Grammars
We present in this paper an approach based on Construction Grammars and completing this framework in order to account for these different mechanisms.
WorldCuisines: A Massive-Scale Benchmark for Multilingual and Multicultural Visual Question Answering on Global Cuisines
This benchmark includes a visual question answering (VQA) dataset with text-image pairs across 30 languages and dialects, spanning 9 language families and featuring over 1 million data points, making it the largest multicultural VQA benchmark to date.
Log Probabilities Are a Reliable Estimate of Semantic Plausibility in Base and Instruction-Tuned Language Models
Semantic plausibility (e. g. knowing that "the actor won the award" is more likely than "the actor won the battle") serves as an effective proxy for general world knowledge.
Extensive Evaluation of Transformer-based Architectures for Adverse Drug Events Extraction
Adverse Event (ADE) extraction is one of the core tasks in digital pharmacovigilance, especially when applied to informal texts.
Empirical Sufficiency Lower Bounds for Language Modeling with Locally-Bootstrapped Semantic Structures
In this work we build upon negative results from an attempt at language modeling with predicted semantic structure, in order to establish empirical lower bounds on what could have made the attempt successful.
Event knowledge in large language models: the gap between the impossible and the unlikely
Overall, our results show that important aspects of event knowledge naturally emerge from distributional linguistic patterns, but also highlight a gap between representations of possible/impossible and likely/unlikely events.
Generalizing over Long Tail Concepts for Medical Term Normalization
Medical term normalization consists in mapping a piece of text to a large number of output classes.
AILAB-Udine@SMM4H 22: Limits of Transformers and BERT Ensembles
This paper describes the models developed by the AILAB-Udine team for the SMM4H 22 Shared Task.
Increasing Adverse Drug Events extraction robustness on social media: case study on negation and speculation
In the last decade, an increasing number of users have started reporting Adverse Drug Events (ADE) on social media platforms, blogs, and health forums.
Multi-label classification for biomedical literature: an overview of the BioCreative VII LitCovid Track for COVID-19 literature topic annotations
To close the gap, we organized the BioCreative LitCovid track to call for a community effort to tackle automated topic annotation for COVID-19 literature.
NADE: A Benchmark for Robust Adverse Drug Events Extraction in Face of Negations
Adverse Drug Event (ADE) extraction models can rapidly examine large collections of social media texts, detecting mentions of drug-related adverse reactions and trigger medical investigations.
Exploring a Unified Sequence-To-Sequence Transformer for Medical Product Safety Monitoring in Social Media
Adverse Events (AE) are harmful events resulting from the use of medical products.
PolyU CBS-Comp at SemEval-2021 Task 1: Lexical Complexity Prediction (LCP)
In this contribution, we describe the system presented by the PolyU CBS-Comp Team at the Task 1 of SemEval 2021, where the goal was the estimation of the complexity of words in a given sentence context.
Did the Cat Drink the Coffee? Challenging Transformers with Generalized Event Knowledge
Prior research has explored the ability of computational models to predict a word semantic fit with a given predicate.
Improving Adverse Drug Event Extraction with SpanBERT on Different Text Typologies
In recent years, Internet users are reporting Adverse Drug Events (ADE) on social media, blogs and health forums.
BERT Prescriptions to Avoid Unwanted Headaches: A Comparison of Transformer Architectures for Adverse Drug Event Detection
Pretrained transformer-based models, such as BERT and its variants, have become a common choice to obtain state-of-the-art performances in NLP tasks.
Automatic Learning of Modality Exclusivity Norms with Crosslingual Word Embeddings
Our experiments focused on crosslingual word embeddings, in order to predict modality association scores by training on a high-resource language and testing on a low-resource one.
Comparing Probabilistic, Distributional and Transformer-Based Models on Logical Metonymy Interpretation
In linguistics and cognitive science, Logical metonymies are defined as type clashes between an event-selecting verb and an entity-denoting noun (e. g.
Using Conceptual Norms for Metaphor Detection
This paper reports a linguistically-enriched method of detecting token-level metaphors for the second shared task on Metaphor Detection.
Ciron: a New Benchmark Dataset for Chinese Irony Detection
Automatic Chinese irony detection is a challenging task, and it has a strong impact on linguistic research.
Are Word Embeddings Really a Bad Fit for the Estimation of Thematic Fit?
While neural embeddings represent a popular choice for word representation in a wide variety of NLP tasks, their usage for thematic fit modeling has been limited, as they have been reported to lag behind syntax-based count models.
Distributional Semantics Meets Construction Grammar. towards a Unified Usage-Based Model of Grammar and Meaning
In this paper, we propose a new type of semantic representation of Construction Grammar that combines constructions with the vector representations used in Distributional Semantics.
A Structured Distributional Model of Sentence Meaning and Processing
In this paper, we propose a Structured Distributional Model (SDM) that combines word embeddings with formal semantics and is based on the assumption that sentences represent events and situations.
Modeling Violations of Selectional Restrictions with Distributional Semantics
Distributional Semantic Models have been successfully used for modeling selectional preferences in a variety of scenarios, since distributional similarity naturally provides an estimate of the degree to which an argument satisfies the requirement of a given predicate.
A Rank-Based Similarity Metric for Word Embeddings
Word Embeddings have recently imposed themselves as a standard for representing word meaning in NLP.
BomJi at SemEval-2018 Task 10: Combining Vector-, Pattern- and Graph-based Information to Identify Discriminative Attributes
This paper describes BomJi, a supervised system for capturing discriminative attributes in word pairs (e. g. yellow as discriminative for banana over watermelon).
Ranked #3 on
Relation Extraction
on SemEval 2018 Task 10
Is Structure Necessary for Modeling Argument Expectations in Distributional Semantics?
Despite the number of NLP studies dedicated to thematic fit estimation, little attention has been paid to the related task of composing and updating verb argument expectations.
Logical Metonymy in a Distributional Model of Sentence Comprehension
In theoretical linguistics, logical metonymy is defined as the combination of an event-subcategorizing verb with an entity-denoting direct object (e. g., The author began the book), so that the interpretation of the VP requires the retrieval of a covert event (e. g., writing).
Measuring Thematic Fit with Distributional Feature Overlap
In this paper, we introduce a new distributional method for modeling predicate-argument thematic fit judgments.
Towards a Distributional Model of Semantic Complexity
The composition cost of a sentence depends on the semantic coherence of the event being constructed and on the activation degree of the linguistic constructions.
CogALex-V Shared Task: ROOT18
Our classifier participated in the CogALex-V Shared Task, showing a solid performance on the first subtask, but a poor performance on the second subtask.
Testing APSyn against Vector Cosine on Similarity Estimation
In Distributional Semantic Models (DSMs), Vector Cosine is widely used to estimate similarity between word vectors, although this measure was noticed to suffer from several shortcomings.
Representing Verbs with Rich Contexts: an Evaluation on Verb Similarity
Several studies on sentence processing suggest that the mental lexicon keeps track of the mutual expectations between words.
