Character-Preserving Coherent Story Visualization

ECCV 2020 Yun-Zhu SongZhi Rui TamHung-Jen ChenHuiao-Han LuHong-Han Shuai

Story visualization aims at generating a sequence of images to narrate each sentence in a multi-sentence story. Different from video generation that focuses on maintaining the continuity of generated images (frames), story visualization emphasizes preserving the global consistency of characters and scenes across different story pictures, which is very challenging since story sentences only provide sparse signals for generating images... (read more)

PDF Abstract

Results from the Paper


 Ranked #1 on Story Visualization on Pororo (using extra training data)

     Get a GitHub badge
TASK DATASET MODEL METRIC NAME METRIC VALUE GLOBAL RANK USES EXTRA
TRAINING DATA
BENCHMARK
Story Visualization Pororo StoryGAN FID 77.67 # 2
FSD 111.09 # 2
Story Visualization Pororo CPCSV FID 67.7 # 1
FSD 71.51 # 1

Methods used in the Paper


METHOD TYPE
🤖 No Methods Found Help the community by adding them if they're not listed; e.g. Deep Residual Learning for Image Recognition uses ResNet