Search Results for author:
Found 4 papers, 0 papers with code
Visual Riddles: a Commonsense and World Knowledge Challenge for Large Vision and Language Models
To study these skills, we present Visual Riddles, a benchmark aimed to test vision and language models on visual riddles requiring commonsense and world knowledge.
Is It Really Long Context if All You Need Is Retrieval? Towards Genuinely Difficult Long Context NLP
By using a descriptive vocabulary and discussing the relevant properties of difficulty in long-context, we can implement more informed research in this area.
CoheSentia: A Novel Benchmark of Incremental versus Holistic Assessment of Coherence in Generated Texts
Up until now, little work has been done on explicitly assessing the coherence of generated texts and analyzing the factors contributing to (in)coherence.
A Novel Computational and Modeling Foundation for Automatic Coherence Assessment
On two benchmarks for coherence scoring rated by humans, one containing 500 automatically-generated short stories and another containing 4k real-world texts, our experiments confirm that jointly training on the proposed tasks leads to better performance on each task compared with task-specific models, and to better performance on assessing coherence overall, compared with strong baselines.
