Search Results for author:
Found 8 papers, 2 papers with code
Language-agnostic Semantic Consistent Text-to-Image Generation
Recent GAN-based text-to-image generation models have advanced that they can generate photo-realistic images matching semantically with descriptions.
Generative Adversarial Network
Multi-lingual Text-to-Image Generation
+2
Continual Vision-and-Language Navigation
For the training and evaluation of CVLN agents, we re-arrange existing VLN datasets to propose two datasets: CVLN-I, focused on navigation via initial-instruction interpretation, and CVLN-D, aimed at navigation through dialogue with other agents.
Overcoming Weak Visual-Textual Alignment for Video Moment Retrieval
Video moment retrieval (VMR) identifies a specific moment in an untrimmed video for a given natural language query.
Ranked #6 on
Moment Retrieval
on Charades-STA
Modal-specific Pseudo Query Generation for Video Corpus Moment Retrieval
Video corpus moment retrieval (VCMR) is the task to retrieve the most relevant video moment from a large video corpus using a natural language query.
Ranked #2 on
Video Corpus Moment Retrieval
on TVR
Toward a Human-Level Video Understanding Intelligence
In this paper, we propose the Video Turing Test to provide effective and practical assessments of video understanding intelligence as well as human-likeness evaluation of AI agents.
Mounting Video Metadata on Transformer-based Language Model for Open-ended Video Question Answering
In this paper, we challenge the existing multiple-choice video question answering by changing it to open-ended video question answering.
CogME: A Cognition-Inspired Multi-Dimensional Evaluation Metric for Story Understanding
We introduce CogME, a cognition-inspired, multi-dimensional evaluation metric designed for AI models focusing on story understanding.
Constructing Hierarchical Q&A Datasets for Video Story Understanding
Video understanding is emerging as a new paradigm for studying human-like AI.
