Search Results for author: Julia Taylor Rayz

Found 17 papers, 9 papers with code

Learning Shortcuts: On the Misleading Promise of NLU in Language Models

no code implementations17 Jan 2024 Geetanjali Bihani, Julia Taylor Rayz

The advent of large language models (LLMs) has enabled significant performance gains in the field of natural language processing.

Natural Language Understanding

Calibration Error Estimation Using Fuzzy Binning

1 code implementation30 Apr 2023 Geetanjali Bihani, Julia Taylor Rayz

Neural network-based decisions tend to be overconfident, where their raw outcome probabilities do not align with the true decision probabilities.

COMPS: Conceptual Minimal Pair Sentences for testing Robust Property Knowledge and its Inheritance in Pre-trained Language Models

1 code implementation5 Oct 2022 Kanishka Misra, Julia Taylor Rayz, Allyson Ettinger

A characteristic feature of human semantic cognition is its ability to not only store and retrieve the properties of concepts observed through experience, but to also facilitate the inheritance of properties (can breathe) from superordinate concepts (animal) to their subordinates (dog) -- i. e. demonstrate property inheritance.

Attribute

A Property Induction Framework for Neural Language Models

1 code implementation13 May 2022 Kanishka Misra, Julia Taylor Rayz, Allyson Ettinger

To what extent can experience from language contribute to our conceptual knowledge?

On Information Hiding in Natural Language Systems

no code implementations12 Mar 2022 Geetanjali Bihani, Julia Taylor Rayz

With data privacy becoming more of a necessity than a luxury in today's digital world, research on more robust models of privacy preservation and information security is on the rise.

Towards The Automatic Coding of Medical Transcripts to Improve Patient-Centered Communication

no code implementations22 Sep 2021 Gilchan Park, Julia Taylor Rayz, Cleveland G. Shields

The result showed that there is evidence to distinguish the codes, and this is considered to be sufficient for training of human annotators.

Do language models learn typicality judgments from text?

1 code implementation6 May 2021 Kanishka Misra, Allyson Ettinger, Julia Taylor Rayz

Building on research arguing for the possibility of conceptual and categorical knowledge acquisition through statistics contained in language, we evaluate predictive language models (LMs) -- informed solely by textual input -- on a prevalent phenomenon in cognitive science: typicality.

Fuzzy Classification of Multi-intent Utterances

no code implementations22 Apr 2021 Geetanjali Bihani, Julia Taylor Rayz

In this work, we propose a scheme to address the ambiguity in single-intent as well as multi-intent natural language utterances by creating degree memberships over fuzzified intent classes.

Classification General Classification +2

Low Anisotropy Sense Retrofitting (LASeR) : Towards Isotropic and Sense Enriched Representations

no code implementations NAACL (DeeLIO) 2021 Geetanjali Bihani, Julia Taylor Rayz

Contextual word representation models have shown massive improvements on a multitude of NLP tasks, yet their word sense disambiguation capabilities remain poorly explained.

Word Sense Disambiguation

Finding Fuzziness in Neural Network Models of Language Processing

1 code implementation22 Apr 2021 Kanishka Misra, Julia Taylor Rayz

Humans often communicate by using imprecise language, suggesting that fuzzy concepts with unclear boundaries are prevalent in language use.

Natural Language Inference

Modeling Fuzzy Cluster Transitions for Topic Tracing

1 code implementation16 Apr 2021 Xiaonan Jing, Yi Zhang, Qingyuan Hu, Julia Taylor Rayz

Twitter can be viewed as a data source for Natural Language Processing (NLP) tasks.

Tracing Topic Transitions with Temporal Graph Clusters

1 code implementation16 Apr 2021 Xiaonan Jing, Qingyuan Hu, Yi Zhang, Julia Taylor Rayz

Twitter serves as a data source for many Natural Language Processing (NLP) tasks.

Clustering

Graph-of-Tweets: A Graph Merging Approach to Sub-event Identification

1 code implementation8 Jan 2021 Xiaonan Jing, Julia Taylor Rayz

We propose a hybrid Graph-of-Tweets (GoT) model which combines the word- and document-level structures for modeling Tweets.

Word Embeddings

Misspelling Correction with Pre-trained Contextual Language Model

no code implementations8 Jan 2021 Yifei Hu, Xiaonan Jing, Youlim Ko, Julia Taylor Rayz

While many programs provide spelling correction functionality, many systems do not take context into account.

Language Modelling Sentence +2

An Event Detection Approach Based On Twitter Hashtags

no code implementations2 Apr 2018 Shih-Feng Yang, Julia Taylor Rayz

We adopted the feature extraction used in STREAMCUBE and applied a clustering K-means approach to it.

Clustering Event Detection

Cannot find the paper you are looking for? You can Submit a new open access paper.