Search Results for author:
Found 20 papers, 13 papers with code
Is Information Density Uniform in Task-Oriented Dialogues?
The Uniform Information Density principle states that speakers plan their utterances to reduce fluctuations in the density of the information transmitted.
Analysing Human Strategies of Information Transmission as a Function of Discourse Context
Speakers are thought to use rational information transmission strategies for efficient communication (Genzel and Charniak, 2002; Aylett and Turk, 2004; Jaeger and Levy, 2007).
AnaLog: Testing Analytical and Deductive Logic Learnability in Language Models
We investigate the extent to which pre-trained language models acquire analytical and deductive logical reasoning capabilities as a side effect of learning word prediction.
LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Models
While both agent interaction and personalisation are vibrant topics in research on large language models (LLMs), there has been limited focus on the effect of language interaction on the behaviour of persona-conditioned LLM agents.
Attribution and Alignment: Effects of Local Context Repetition on Utterance Production and Comprehension in Dialogue
Language models are often used as the backbone of modern dialogue systems.
Information Value: Measuring Utterance Predictability as Distance from Plausible Alternatives
We present information value, a measure which quantifies the predictability of an utterance relative to a set of plausible alternatives.
Speaking the Language of Your Listener: Audience-Aware Adaptation via Plug-and-Play Theory of Mind
Inspired by psycholinguistic theories, we endow our speaker with the ability to adapt its referring expressions via a simulation module that monitors the effectiveness of planned utterances from the listener's perspective.
What Comes Next? Evaluating Uncertainty in Neural Text Generators Against Human Production Variability
In Natural Language Generation (NLG) tasks, for any input, multiple communicative goals are plausible, and any goal can be put into words, or produced, in multiple ways.
Interpretable Word Sense Representations via Definition Generation: The Case of Semantic Change Analysis
We propose using automatically generated natural language definitions of contextualised word usages as interpretable word and word sense representations.
Towards Pragmatic Production Strategies for Natural Language Generation Tasks
This position paper proposes a conceptual framework for the design of Natural Language Generation (NLG) systems that follow efficient and effective production strategies in order to achieve complex communicative goals.
Construction Repetition Reduces Information Rate in Dialogue
We hypothesise that speakers use construction repetition to mitigate information rate, leading to an overall decrease in utterance information content over the course of a dialogue.
State-of-the-art generalisation research in NLP: A taxonomy and review
We present a taxonomy for characterising and understanding generalisation research in NLP.
Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
BIG-bench focuses on tasks that are believed to be beyond the capabilities of current language models.
Do Not Fire the Linguist: Grammatical Profiles Help Language Models Detect Semantic Change
In this work, we explore whether large pre-trained contextualised language models, a common tool for lexical semantic change detection, are sensitive to such morphosyntactic changes.
Grammatical Profiling for Semantic Change Detection
Semantics, morphology and syntax are strongly interdependent.
Refer, Reuse, Reduce: Generating Subsequent References in Visual and Conversational Contexts
We propose a generation model that produces referring utterances grounded in both the visual and the conversational context.
UiO-UvA at SemEval-2020 Task 1: Contextualised Embeddings for Lexical Semantic Change Detection
We apply contextualised word embeddings to lexical semantic change detection in the SemEval-2020 Shared Task 1.
Analysing Lexical Semantic Change with Contextualised Word Representations
This paper presents the first unsupervised approach to lexical semantic change that makes use of contextualised word representations.
Under the Hood: Using Diagnostic Classifiers to Investigate and Improve how Language Models Track Agreement Information
We show that `diagnostic classifiers', trained to predict number from the internal states of a language model, provide a detailed understanding of how, when, and where this information is represented.
Semi-supervised emotion lexicon expansion with label propagation and specialized word embeddings
There exist two main approaches to automatically extract affective orientation: lexicon-based and corpus-based.
