References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Film Trailer Generation via Task Decomposition
(Submitted on 16 Nov 2021)
Abstract: Movie trailers perform multiple functions: they introduce viewers to the story, convey the mood and artistic style of the film, and encourage audiences to see the movie. These diverse functions make automatic trailer generation a challenging endeavor. We decompose it into two subtasks: narrative structure identification and sentiment prediction. We model movies as graphs, where nodes are shots and edges denote semantic relations between them. We learn these relations using joint contrastive training which leverages privileged textual information (e.g., characters, actions, situations) from screenplays. An unsupervised algorithm then traverses the graph and generates trailers that human judges prefer to ones generated by competitive supervised approaches.
Submission history
From: Pinelopi Papalampidi [view email][v1] Tue, 16 Nov 2021 20:50:52 GMT (14164kb,D)
Link back to: arXiv, form interface, contact.