Current browse context:
cs.CV
Change to browse by:
References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: GOAL: A Challenging Knowledge-grounded Video Captioning Benchmark for Real-time Soccer Commentary Generation
(Submitted on 26 Mar 2023 (v1), last revised 5 Oct 2023 (this version, v2))
Abstract: Despite the recent emergence of video captioning models, how to generate vivid, fine-grained video descriptions based on the background knowledge (i.e., long and informative commentary about the domain-specific scenes with appropriate reasoning) is still far from being solved, which however has great applications such as automatic sports narrative. In this paper, we present GOAL, a benchmark of over 8.9k soccer video clips, 22k sentences, and 42k knowledge triples for proposing a challenging new task setting as Knowledge-grounded Video Captioning (KGVC). Moreover, we conduct experimental adaption of existing methods to show the difficulty and potential directions for solving this valuable and applicable task. Our data and code are available at this https URL
Submission history
From: Ji Qi [view email][v1] Sun, 26 Mar 2023 08:43:36 GMT (5762kb,D)
[v2] Thu, 5 Oct 2023 06:55:13 GMT (5765kb,D)
Link back to: arXiv, form interface, contact.