References & Citations
Computer Science > Computation and Language
Title: Plot and Rework: Modeling Storylines for Visual Storytelling
(Submitted on 14 May 2021 (v1), last revised 7 Jul 2021 (this version, v3))
Abstract: Writing a coherent and engaging story is not easy. Creative writers use their knowledge and worldview to put disjointed elements together to form a coherent storyline, and work and rework iteratively toward perfection. Automated visual storytelling (VIST) models, however, make poor use of external knowledge and iterative generation when attempting to create stories. This paper introduces PR-VIST, a framework that represents the input image sequence as a story graph in which it finds the best path to form a storyline. PR-VIST then takes this path and learns to generate the final story via an iterative training process. This framework produces stories that are superior in terms of diversity, coherence, and humanness, per both automatic and human evaluations. An ablation study shows that both plotting and reworking contribute to the model's superiority.
Submission history
From: Yun-Wei Chu [view email][v1] Fri, 14 May 2021 16:41:29 GMT (7519kb,D)
[v2] Sun, 23 May 2021 19:13:55 GMT (7519kb,D)
[v3] Wed, 7 Jul 2021 14:59:28 GMT (7515kb,D)
Link back to: arXiv, form interface, contact.