References & Citations
Computer Science > Computation and Language
Title: Visual Semantic Relatedness Dataset for Image Captioning
(Submitted on 20 Jan 2023 (v1), last revised 30 Apr 2023 (this version, v2))
Abstract: Modern image captioning system relies heavily on extracting knowledge from images to capture the concept of a static story. In this paper, we propose a textual visual context dataset for captioning, in which the publicly available dataset COCO Captions (Lin et al., 2014) has been extended with information about the scene (such as objects in the image). Since this information has a textual form, it can be used to leverage any NLP task, such as text similarity or semantic relation methods, into captioning systems, either as an end-to-end training strategy or a post-processing based approach.
Submission history
From: Ahmed Sabir [view email][v1] Fri, 20 Jan 2023 20:04:35 GMT (4409kb,D)
[v2] Sun, 30 Apr 2023 20:23:09 GMT (4352kb,D)
Link back to: arXiv, form interface, contact.