Search Results for author:
Found 98 papers, 34 papers with code
Putting Words in BERT’s Mouth: Navigating Contextualized Vector Spaces with Pseudowords
We present a method for exploring regions around individual points in a contextualized vector space (particularly, BERT space), as a way to investigate how these regions correspond to word senses.
A Balanced and Broadly Targeted Computational Linguistics Curriculum
This paper describes the primarily-graduate computational linguistics and NLP curriculum at Georgetown University, a U. S. university that has seen significant growth in these areas in recent years.
Probe-Less Probing of BERT’s Layer-Wise Linguistic Knowledge with Masked Word Prediction
The current study quantitatively (and qualitatively for an illustrative purpose) analyzes BERT’s layer-wise masked word prediction on an English corpus, and finds that (1) the layerwise localization of linguistic knowledge primarily shown in probing studies is replicated in a behavior-based design and (2) that syntactic and semantic information is encoded at different layers for words of different syntactic categories.
K-SNACS: Annotating Korean Adposition Semantics
While many languages use adpositions to encode semantic relationships between content words in a sentence (e. g., agentivity or temporality), the details of how adpositions work vary widely across languages with respect to both form and meaning.
Classifying Divergences in Cross-lingual AMR Pairs
Translation divergences are varied and widespread, challenging approaches that rely on parallel text.
Subcategorizing Adverbials in Universal Conceptual Cognitive Annotation
Universal Conceptual Cognitive Annotation (UCCA) is a semantic annotation scheme that organizes texts into coarse predicate-argument structure, offering broad coverage of semantic phenomena.
Sprucing up Supersenses: Untangling the Semantic Clusters of Accompaniment and Purpose
We reevaluate an existing adpositional annotation scheme with respect to two thorny semantic domains: accompaniment and purpose.
Accounting for Language Effect in the Evaluation of Cross-lingual AMR Parsers
Cross-lingual Abstract Meaning Representation (AMR) parsers are currently evaluated in comparison to gold English AMRs, despite parsing a language other than English, due to the lack of multilingual AMR evaluation metrics.
Putting Context in SNACS: A 5-Way Classification of Adpositional Pragmatic Markers
The SNACS framework provides a network of semantic labels called supersenses for annotating adpositional semantics in corpora.
Effect of Source Language on AMR Structure
In this work, we investigate the similarity of AMR annotations in parallel data and how much the language matters in terms of the graph structure.
Xposition: An Online Multilingual Database of Adpositional Semantics
We present Xposition, an online platform for documenting adpositional semantics across languages in terms of supersenses (Schneider et al., 2018).
Natural Language Processing RELIES on Linguistics
Large Language Models (LLMs) have become capable of generating highly fluent text in certain languages, without modules specially designed to capture grammar or semantic coherence.
UCxn: Typologically Informed Annotation of Constructions Atop Universal Dependencies
The Universal Dependencies (UD) project has created an invaluable collection of treebanks with contributions in over 140 languages.
Syntactic Inductive Bias in Transformer Language Models: Especially Helpful for Low-Resource Languages?
A line of work on Transformer-based language models such as BERT has attempted to use syntactic inductive bias to enhance the pretraining process, on the theory that building syntactic structure into the training process should reduce the amount of data needed for training.
AMR4NLI: Interpretable and robust NLI measures from semantic graphs
The task of natural language inference (NLI) asks whether a given premise (expressed in NL) entails a given NL hypothesis.
CGELBank Annotation Manual v1.1
CGELBank is a treebank and associated tools based on a syntactic formalism for English derived from the Cambridge Grammar of the English Language.
CuRIAM: Corpus re Interpretation and Metalanguage in U.S. Supreme Court Opinions
Most judicial decisions involve the interpretation of legal texts; as such, judicial opinion requires the use of language as a medium to comment on or draw attention to other language.
Lost in Translationese? Reducing Translation Effect Using Abstract Meaning Representation
Though individual translated texts are often fluent and preserve meaning, at a large scale, translated texts have statistical tendencies which distinguish them from text originally written in the language ("translationese") and can affect model performance.
Are UD Treebanks Getting More Consistent? A Report Card for English UD
Recent efforts to consolidate guidelines and treebanks in the Universal Dependencies project raise the expectation that joint training and dataset comparison is increasingly possible for high-resource languages such as English, which have multiple corpora.
Sentence-level Feedback Generation for English Language Learners: Does Data Augmentation Help?
In this paper, we present strong baselines for the task of Feedback Comment Generation for Writing Learning.
Measuring Fine-Grained Semantic Equivalence with Abstract Meaning Representation
Identifying semantically equivalent sentences is important for many cross-lingual and mono-lingual NLP tasks.
CGELBank: CGEL as a Framework for English Syntax Annotation
We introduce the syntactic formalism of the \textit{Cambridge Grammar of the English Language} (CGEL) to the world of treebanking through the CGELBank project.
MASALA: Modelling and Analysing the Semantics of Adpositions in Linguistic Annotation of Hindi
We present a completed, publicly available corpus of annotated semantic relations of adpositions and case markers in Hindi.
ELQA: A Corpus of Metalinguistic Questions and Answers about English
We present ELQA, a corpus of questions and answers in and about the English language.
Spanish Abstract Meaning Representation: Annotation of a General Corpus
The Abstract Meaning Representation (AMR) formalism, designed originally for English, has been adapted to a number of languages.
DocAMR: Multi-Sentence AMR Representation and Evaluation
Despite extensive research on parsing of English sentences into Abstraction Meaning Representation (AMR) graphs, which are compared to gold graphs via the Smatch metric, full-document parsing into a unified graph representation lacks well-defined representation and evaluation.
Linguistic Frameworks Go Toe-to-Toe at Neuro-Symbolic Language Modeling
We examine the extent to which, in principle, linguistic graph representations can complement and improve neural language modeling.
PASTRIE: A Corpus of Prepositions Annotated with Supersense Tags in Reddit International English
We present the Prepositions Annotated with Supersense Tags in Reddit International English ("PASTRIE") corpus, a new dataset containing manually annotated preposition supersenses of English data from presumed speakers of four L1s: English, French, German, and Spanish.
Putting Words in BERT's Mouth: Navigating Contextualized Vector Spaces with Pseudowords
We present a method for exploring regions around individual points in a contextualized vector space (particularly, BERT space), as a way to investigate how these regions correspond to word senses.
Cross-linguistically Consistent Semantic and Syntactic Annotation of Child-directed Speech
We then demonstrate the utility of the compiled corpora through (1) a longitudinal corpus study of the prevalence of different syntactic and semantic phenomena in the CDS, and (2) applying an existing computational model of language acquisition to the two corpora and briefly comparing the results across languages.
BERT Has Uncommon Sense: Similarity Ranking for Word Sense BERTology
An important question concerning contextualized word embedding (CWE) models like BERT is how well they can represent different word senses, especially those in the long tail of uncommon senses.
Making Heads and Tails of Models with Marginal Calibration for Sparse Tagsets
For interpreting the behavior of a probabilistic model, it is useful to measure a model's calibration--the extent to which it produces reliable confidence scores.
Mischievous Nominal Constructions in Universal Dependencies
While the highly multilingual Universal Dependencies (UD) project provides extensive guidelines for clausal structure as well as structure within canonical nominal phrases, a standard treatment is lacking for many "mischievous" nominal phenomena that break the mold.
Probabilistic, Structure-Aware Algorithms for Improved Variety, Accuracy, and Coverage of AMR Alignments
We present algorithms for aligning components of Abstract Meaning Representation (AMR) graphs to spans in English sentences.
Supersense and Sensibility: Proxy Tasks for Semantic Annotation of Prepositions
Prepositional supersense annotation is time-consuming and requires expert training.
Hindi-Urdu Adposition and Case Supersenses v1.0
These are the guidelines for the application of SNACS (Semantic Network of Adposition and Case Supersenses; Schneider et al. 2018) to Modern Standard Hindi of Delhi.
UCCA's Foundational Layer: Annotation Guidelines v2.1
This is the annotation manual for Universal Conceptual Cognitive Annotation (UCCA; Abend and Rappoport, 2013), specifically the Foundational Layer.
Supertagging the Long Tail with Tree-Structured Decoding of Complex Categories
Our best tagger is capable of recovering a sizeable fraction of the long-tail supertags and even generates CCG categories that have never been seen in training, while approximating the prior state of the art in overall tag accuracy with fewer parameters.
Cross-lingual Semantic Representation for NLP with UCCA
This is an introductory tutorial to UCCA (Universal Conceptual Cognitive Annotation), a cross-linguistically applicable framework for semantic representation, with corpora annotated in English, German and French, and ongoing annotation in Russian and Hebrew.
Comparison by Conversion: Reverse-Engineering UCCA from Syntax and Lexical Semantics
Building robust natural language understanding systems will require a clear characterization of whether and how various linguistic meaning representations complement each other.
(Re)construing Meaning in NLP
Human speakers have an extensive toolkit of ways to express themselves.
Lexical Semantic Recognition
In lexical semantics, full-sentence segmentation and segment labeling of various phenomena are generally treated separately, despite their interdependence.
Ranked #1 on
Natural Language Understanding
on STREUSLE
Supervised Grapheme-to-Phoneme Conversion of Orthographic Schwas in Hindi and Punjabi
Hindi grapheme-to-phoneme (G2P) conversion is mostly trivial, with one exception: whether a schwa represented in the orthography is pronounced or unpronounced (deleted).
A Human Evaluation of AMR-to-English Generation Systems
Most current state-of-the art systems for generating English text from Abstract Meaning Representation (AMR) have been evaluated only using automated metrics, such as BLEU, which are known to be problematic for natural language generation.
A Corpus of Adpositional Supersenses for Mandarin Chinese
Adpositions are frequent markers of semantic relations, but they are highly ambiguous and vary significantly from language to language.
Made for Each Other: Broad-coverage Semantic Structures Meet Preposition Supersenses
Universal Conceptual Cognitive Annotation (UCCA; Abend and Rappoport, 2013) is a typologically-informed, broad-coverage semantic annotation scheme that describes coarse-grained predicate-argument structure but currently lacks semantic roles.
Preparing SNACS for Subjects and Objects
Research on adpositions and possessives in multiple languages has led to a small inventory of general-purpose meaning classes that disambiguate tokens.
Semantically Constrained Multilayer Annotation: The Case of Coreference
We propose a coreference annotation scheme as a layer on top of the Universal Conceptual Cognitive Annotation foundational layer, treating units in predicate-argument structure as a basis for entity and event mentions.
An Improved Approach for Semantic Graph Composition with CCG
We define new semantics for the CCG combinators that is better suited to deriving AMR graphs.
Adpositional Supersenses for Mandarin Chinese
This study adapts Semantic Network of Adposition and Case Supersenses (SNACS) annotation to Mandarin Chinese and demonstrates that the same supersense categories are appropriate for Chinese adposition semantics.
Annotation of Tense and Aspect Semantics for Sentential AMR
Although English grammar encodes a number of semantic contrasts with tense and aspect marking, these semantics are currently ignored by Abstract Meaning Representation (AMR) annotations.
Constructing an Annotated Corpus of Verbal MWEs for English
This paper describes the construction and annotation of a corpus of verbal MWEs for English, as part of the PARSEME Shared Task 1. 1 on automatic identification of verbal MWEs.
Edition 1.1 of the PARSEME Shared Task on Automatic Identification of Verbal Multiword Expressions
Corpora were created for 20 languages, which are also briefly discussed.
Leaving no token behind: comprehensive (and delicious) annotation of MWEs and supersenses
I will describe an unorthodox approach to lexical semantic annotation that prioritizes corpus coverage, democratizing analysis of a wide range of expression types.
Discourse Coherence: Concurrent Explicit and Implicit Relations
Theories of discourse coherence posit relations between discourse segments as a key feature of coherent text.
A Structured Syntax-Semantics Interface for English-AMR Alignment
Abstract Meaning Representation (AMR) annotations are often assumed to closely mirror dependency syntax, but AMR explicitly does not require this, and the assumption has never been tested.
Comprehensive Supersense Disambiguation of English Prepositions and Possessives
Semantic relations are often signaled with prepositional or possessive marking--but extreme polysemy bedevils their analysis and automatic interpretation.
Ranked #4 on
Natural Language Understanding
on STREUSLE
(Role F1 (Preps) metric)
Parsing Tweets into Universal Dependencies
Nonetheless, using the new treebank, we build a pipeline system to parse raw tweets into UD.
Ranked #2 on
Dependency Parsing
on Tweebank
Double Trouble: The Problem of Construal in Semantic Annotation of Adpositions
We consider the semantics of prepositions, revisiting a broad-coverage annotation scheme used for annotating all 4, 250 preposition tokens in a 55, 000 word corpus of English.
Adposition and Case Supersenses v2.6: Guidelines for English
This document offers a detailed linguistic description of SNACS (Semantic Network of Adposition and Case Supersenses; Schneider et al., 2018), an inventory of 52 semantic labels ("supersenses") that characterize the use of adpositions and case markers at a somewhat coarse level of granularity, as demonstrated in the STREUSLE corpus (https://github. com/nert-nlp/streusle/ ; version 4. 5 tracks guidelines version 2. 6).
The NLTK FrameNet API: Designing for Discoverability with a Rich Linguistic Resource
A new Python API, integrated within the NLTK suite, offers access to the FrameNet 1. 7 lexical database.
Coping with Construals in Broad-Coverage Semantic Annotation of Adpositions
We consider the semantics of prepositions, revisiting a broad-coverage annotation scheme used for annotating all 4, 250 preposition tokens in a 55, 000 word corpus of English.
A corpus of preposition supersenses in English web reviews
We present the first corpus annotated with preposition supersenses, unlexicalized categories for semantic functions that can be marked by English prepositions (Schneider et al., 2015).
Inconsistency Detection in Semantic Annotation
Automatically finding these inconsistencies and correcting them (even manually) can increase the quality of the data.
Big Data Small Data, In Domain Out-of Domain, Known Word Unknown Word: The Impact of Word Representation on Sequence Labelling Tasks
Word embeddings -- distributed word representations that can be learned from unlabelled data -- have been shown to have high utility in many natural language processing applications.
Augmenting English Adjective Senses with Supersenses
We develop a supersense taxonomy for adjectives, based on that of GermaNet, and apply it to English adjectives in WordNet using human annotation and supervised classification.
Comprehensive Annotation of Multiword Expressions in a Social Web Corpus
Multiword expressions (MWEs) are quite frequent in languages such as English, but their diversity, the scarcity of individual MWE types, and contextual ambiguity have presented obstacles to corpus-based studies and NLP systems addressing them as a class.
Discriminative Lexical Semantic Segmentation with Gaps: Running the MWE Gamut
We present a novel representation, evaluation measure, and supervised models for the task of identifying the multiword expressions (MWEs) in a sentence, resulting in a lexical semantic segmentation.
A framework for (under)specifying dependency syntax without overloading annotators
We introduce a framework for lightweight dependency syntax annotation.
