References & Citations
Computer Science > Computation and Language
Title: Word to Sentence Visual Semantic Similarity for Caption Generation: Lessons Learned
(Submitted on 26 Sep 2022 (v1), last revised 6 Jul 2023 (this version, v2))
Abstract: This paper focuses on enhancing the captions generated by image-caption generation systems. We propose an approach for improving caption generation systems by choosing the most closely related output to the image rather than the most likely output produced by the model. Our model revises the language generation output beam search from a visual context perspective. We employ a visual semantic measure in a word and sentence level manner to match the proper caption to the related information in the image. The proposed approach can be applied to any caption system as a post-processing based method.
Submission history
From: Ahmed Sabir [view email][v1] Mon, 26 Sep 2022 16:24:13 GMT (4526kb,D)
[v2] Thu, 6 Jul 2023 22:58:11 GMT (5026kb,D)
Link back to: arXiv, form interface, contact.