Story Realization: Expanding Plot Events into Sentences

Neural network based approaches to automated story plot generation attempt to learn how to generate novel plots from a corpus of natural language plot summaries. Prior work has shown that a semantic abstraction of sentences called events improves neural plot generation and and allows one to decompose the problem into: (1) the generation of a sequence of events (event-to-event) and (2) the transformation of these events into natural language sentences (event-to-sentence). However, typical neural language generation approaches to event-to-sentence can ignore the event details and produce grammatically-correct but semantically-unrelated sentences. We present an ensemble-based model that generates natural language guided by events.We provide results---including a human subjects study---for a full end-to-end automated story generation system showing that our method generates more coherent and plausible stories than baseline approaches.

PDF Abstract

Datasets


Introduced in the Paper:

Scifi TV Shows

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Event Expansion Scifi TV Shows Finite State Machine (FSM) Perplexity 104.775 # 8
BLEU 1.25 # 8
ROUGE 1.29 # 9
Average Sentence Length 10.98 # 1
Event Expansion Scifi TV Shows Monte Carlo (MC) BLEU 4.53 # 4
ROUGE 10.01 # 6
Average Sentence Length 7.91 # 6
Event Expansion Scifi TV Shows Full Ensemble Perplexity 70.179 # 1
BLEU 4.81 # 1
ROUGE 11.18 # 2
Average Sentence Length 9.22 # 4
Event Expansion Scifi TV Shows RetEdit + Templates + MC Perplexity 73.637 # 4
BLEU 4.62 # 3
Event Expansion Scifi TV Shows Templates + Finite State Machine (FSM) Perplexity 79.238 # 5
BLEU 2.96 # 7
ROUGE 6.36 # 7
Average Sentence Length 9.09 # 5
Event Expansion Scifi TV Shows Templates + Monte Carlo (MC) Perplexity 79.295 # 6
ROUGE 10.1 # 5
Average Sentence Length 6.92 # 7
Event Expansion Scifi TV Shows RetEdit + Monte Carlo (MC) Perplexity 72.441 # 3
BLEU 4.68 # 2
ROUGE 10.97 # 3
Average Sentence Length 9.41 # 2
Event Expansion Scifi TV Shows Seq2Seq Perplexity 83.41 # 7
BLEU 4 # 6
ROUGE 10.66 # 4
Average Sentence Length 6.59 # 8
Event Expansion Scifi TV Shows Templates Perplexity 203.629 # 9
BLEU 0.34 # 9
ROUGE 6.21 # 8
Average Sentence Length 5.43 # 9
Event Expansion Scifi TV Shows RetEdit Perplexity 71.354 # 2
BLEU 4.1 # 5
ROUGE 11.25 # 1
Average Sentence Length 9.27 # 3

Methods


No methods listed for this paper. Add relevant methods here