Visual Storytelling

( Image credit: No Metrics Are Perfect )

Leaderboards

Latest papers with code

Knowledge-Enriched Visual Storytelling

3 Dec 2019zychen423/KE-VIST

This paper introduces KG-Story, a three-stage framework that allows the story generation model to take advantage of external Knowledge Graphs to produce interesting stories.

KNOWLEDGE GRAPHS VISUAL STORYTELLING

11
03 Dec 2019

What Makes A Good Story? Designing Composite Rewards for Visual Storytelling

11 Sep 2019JunjieHu/ReCo-RL

Previous storytelling approaches mostly focused on optimizing traditional metrics such as BLEU, ROUGE and CIDEr.

VISUAL STORYTELLING

9
11 Sep 2019

Visual Story Post-Editing

ACL 2019 tingyaohsu/VIST-Edit

We introduce the first dataset for human edits of machine-generated visual stories and explore how these collected edits may be used for the visual story post-editing task.

VISUAL STORYTELLING

10
05 Jun 2019

Knowledgeable Storyteller: A Commonsense-Driven Generative Model for Visual Storytelling

IJCAI 2019 2019 lancopku/CVST

The visual storytelling (VST) task aims at generating a reasonable and coherent paragraph-level story with the image stream as input.

KNOWLEDGE GRAPHS SEMANTIC SIMILARITY SEMANTIC TEXTUAL SIMILARITY VISUAL STORYTELLING

7
04 May 2019

Visual Discourse Parsing

6 Mar 2019arjunakula/Visual-Discourse-Parsing

We propose the task of Visual Discourse Parsing, which requires understanding discourse relations among scenes in a video.

VISUAL DIALOG VISUAL STORYTELLING

0
06 Mar 2019

Contextualize, Show and Tell: A Neural Visual Storyteller

3 Jun 2018dgonzalez-ri/neural-visual-storyteller

We present a neural model for generating short stories from image sequences, which extends the image description model by Vinyals et al. (Vinyals et al., 2015).

VISUAL STORYTELLING

17
03 Jun 2018

GLAC Net: GLocal Attention Cascading Networks for Multi-image Cued Story Generation

28 May 2018tkim-snu/GLACNet

The task of multi-image cued story generation, such as visual storytelling dataset (VIST) challenge, is to compose multiple coherent sentences from a given sequence of images.

VISUAL STORYTELLING

34
28 May 2018

No Metrics Are Perfect: Adversarial Reward Learning for Visual Storytelling

ACL 2018 littlekobe/AREL

Though impressive results have been achieved in visual captioning, the task of generating abstract stories from photo streams is still a little-tapped problem.

IMAGE CAPTIONING VISUAL STORYTELLING

107
24 Apr 2018

Visual Storytelling

NAACL 2016 Pendulibrium/ai-visual-storytelling-seq2seq

We introduce the first dataset for sequential vision-to-language, and explore how this data may be used for the task of visual storytelling.

VISUAL STORYTELLING

29
13 Apr 2016