Story Realization: Expanding Plot Events into Sentences

8 Sep 2019  ยท  Prithviraj Ammanabrolu, Ethan Tien, Wesley Cheung, Zhaochen Luo, William Ma, Lara J. Martin, Mark O. Riedl ยท

Neural network based approaches to automated story plot generation attempt to learn how to generate novel plots from a corpus of natural language plot summaries. Prior work has shown that a semantic abstraction of sentences called events improves neural plot generation and and allows one to decompose the problem into: (1) the generation of a sequence of events (event-to-event) and (2) the transformation of these events into natural language sentences (event-to-sentence). However, typical neural language generation approaches to event-to-sentence can ignore the event details and produce grammatically-correct but semantically-unrelated sentences. We present an ensemble-based model that generates natural language guided by events.We provide results---including a human subjects study---for a full end-to-end automated story generation system showing that our method generates more coherent and plausible stories than baseline approaches.

PDF Abstract

Datasets


Introduced in the Paper:

Scifi TV Shows

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Event Expansion Scifi TV Shows Finite State Machine (FSM) Perplexity 104.775 # 8
BLEU 1.25 # 8
ROUGE 1.29 # 9
Average Sentence Length 10.98 # 1
Event Expansion Scifi TV Shows Monte Carlo (MC) BLEU 4.53 # 4
ROUGE 10.01 # 6
Average Sentence Length 7.91 # 6
Event Expansion Scifi TV Shows Full Ensemble Perplexity 70.179 # 1
BLEU 4.81 # 1
ROUGE 11.18 # 2
Average Sentence Length 9.22 # 4
Event Expansion Scifi TV Shows RetEdit + Templates + MC Perplexity 73.637 # 4
BLEU 4.62 # 3
Event Expansion Scifi TV Shows Templates + Finite State Machine (FSM) Perplexity 79.238 # 5
BLEU 2.96 # 7
ROUGE 6.36 # 7
Average Sentence Length 9.09 # 5
Event Expansion Scifi TV Shows Templates + Monte Carlo (MC) Perplexity 79.295 # 6
ROUGE 10.1 # 5
Average Sentence Length 6.92 # 7
Event Expansion Scifi TV Shows RetEdit + Monte Carlo (MC) Perplexity 72.441 # 3
BLEU 4.68 # 2
ROUGE 10.97 # 3
Average Sentence Length 9.41 # 2
Event Expansion Scifi TV Shows Seq2Seq Perplexity 83.41 # 7
BLEU 4 # 6
ROUGE 10.66 # 4
Average Sentence Length 6.59 # 8
Event Expansion Scifi TV Shows Templates Perplexity 203.629 # 9
BLEU 0.34 # 9
ROUGE 6.21 # 8
Average Sentence Length 5.43 # 9
Event Expansion Scifi TV Shows RetEdit Perplexity 71.354 # 2
BLEU 4.1 # 5
ROUGE 11.25 # 1
Average Sentence Length 9.27 # 3

Methods


No methods listed for this paper. Add relevant methods here