Search Results for author:
Found 8 papers, 5 papers with code
Video Question Answering with Phrases via Semantic Roles
Video Question Answering (VidQA) evaluation metrics have been limited to a single-word answer or selecting a phrase from a fixed set of phrases.
Visual Semantic Role Labeling for Video Understanding
We propose a new framework for understanding and representing related salient events in a video using visual semantic role labeling.
Utilizing Every Image Object for Semi-supervised Phrase Grounding
The annotated language queries available during training are limited, which also limits the variations of language combinations that a model can see during training.
Gradient-based Editing of Memory Examples for Online Task-free Continual Learning
We explore task-free continual learning (CL), in which a model is trained to avoid catastrophic forgetting in the absence of explicit task boundaries or identities.
Visually Grounded Continual Learning of Compositional Phrases
To study this human-like language acquisition ability, we present VisCOLL, a visually grounded language learning task, which simulates the continual acquisition of compositional phrases from streaming visual scenes.
Video Object Grounding using Semantic Roles in Language Description
We explore the task of Video Object Grounding (VOG), which grounds objects in videos referred to in natural language descriptions.
Zero-Shot Grounding of Objects from Natural Language Queries
A phrase grounding system localizes a particular object in an image referred to by a natural language query.
