Visual Storytelling

( Image credit: No Metrics Are Perfect )

Leaderboards

No evaluation results yet. Help compare methods by submit evaluation metrics.

Greatest papers with code

No Metrics Are Perfect: Adversarial Reward Learning for Visual Storytelling

ACL 2018 littlekobe/AREL

Though impressive results have been achieved in visual captioning, the task of generating abstract stories from photo streams is still a little-tapped problem.

IMAGE CAPTIONING VISUAL STORYTELLING

GLAC Net: GLocal Attention Cascading Networks for Multi-image Cued Story Generation

28 May 2018tkim-snu/GLACNet

The task of multi-image cued story generation, such as visual storytelling dataset (VIST) challenge, is to compose multiple coherent sentences from a given sequence of images.

VISUAL STORYTELLING

Visual Storytelling

NAACL 2016 Pendulibrium/ai-visual-storytelling-seq2seq

We introduce the first dataset for sequential vision-to-language, and explore how this data may be used for the task of visual storytelling.

VISUAL STORYTELLING

Contextualize, Show and Tell: A Neural Visual Storyteller

3 Jun 2018dgonzalez-ri/neural-visual-storyteller

We present a neural model for generating short stories from image sequences, which extends the image description model by Vinyals et al. (Vinyals et al., 2015).

VISUAL STORYTELLING

Knowledge-Enriched Visual Storytelling

3 Dec 2019zychen423/KE-VIST

This paper introduces KG-Story, a three-stage framework that allows the story generation model to take advantage of external Knowledge Graphs to produce interesting stories.

KNOWLEDGE GRAPHS VISUAL STORYTELLING

Visual Story Post-Editing

ACL 2019 tingyaohsu/VIST-Edit

We introduce the first dataset for human edits of machine-generated visual stories and explore how these collected edits may be used for the visual story post-editing task.

VISUAL STORYTELLING

Knowledgeable Storyteller: A Commonsense-Driven Generative Model for Visual Storytelling

IJCAI 2019 2019 lancopku/CVST

The visual storytelling (VST) task aims at generating a reasonable and coherent paragraph-level story with the image stream as input.

KNOWLEDGE GRAPHS SEMANTIC SIMILARITY SEMANTIC TEXTUAL SIMILARITY VISUAL STORYTELLING

Visual Discourse Parsing

6 Mar 2019arjunakula/Visual-Discourse-Parsing

We propose the task of Visual Discourse Parsing, which requires understanding discourse relations among scenes in a video.

VISUAL DIALOG VISUAL STORYTELLING