Aligning Images and Text with Semantic Role Labels for Fine-Grained Cross-Modal Understanding

no code implementations • LREC 2022 • Abhidip Bhattacharyya, Cecilia Mauceri, Martha Palmer, Christoffer Heckman

As vision processing and natural language processing continue to advance, there is increasing interest in multimodal applications, such as image retrieval, caption generation, and human-robot interaction.

Caption Generation Image Retrieval +2

Leveraging Non-Specialists for Accurate and Time Efficient AMR Annotation

no code implementations • LREC 2020 • Mary Martin, Cecilia Mauceri, Martha Palmer, Christoffer Heckman

Abstract Meaning Representations (AMRs), a syntax-free representation of phrase semantics are useful for capturing the meaning of a phrase and reflecting the relationship between concepts that are referred to.

Referring Expression Referring Expression Comprehension