Search Results for author:
Found 6 papers, 1 papers with code
Predictions from language models for multiple-choice tasks are not robust under variation of scoring methods
This paper systematically compares different methods of deriving item-level predictions of language models for multiple-choice tasks.
Evaluating Pragmatic Abilities of Image Captioners on A3DS
Evaluating grounded neural language model performance with respect to pragmatic qualities like the trade off between truthfulness, contrastivity and overinformativity of generated utterances remains a challenge in absence of data collected from humans.
Overinformative Question Answering by Humans and Machines
When faced with a polar question, speakers often provide overinformative answers going beyond a simple "yes" or "no".
A practical introduction to the Rational Speech Act modeling framework
Recent advances in computational cognitive science (i. e., simulation-based probabilistic programs) have paved the way for significant progress in formal, implementable models of pragmatics.
Probabilistic modeling of rational communication with conditionals
While a large body of work has scrutinized the meaning of conditional sentences, considerably less attention has been paid to formal models of their pragmatic use and interpretation.
From partners to populations: A hierarchical Bayesian account of coordination and convention
Languages are powerful solutions to coordination problems: they provide stable, shared expectations about how the words we say correspond to the beliefs and intentions in our heads.
