We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Automated Audio Captioning with Epochal Difficult Captions for Curriculum Learning

Abstract: In this paper, we propose an algorithm, Epochal Difficult Captions, to supplement the training of any model for the Automated Audio Captioning task. Epochal Difficult Captions is an elegant evolution to the keyword estimation task that previous work have used to train the encoder of the AAC model. Epochal Difficult Captions modifies the target captions based on a curriculum and a difficulty level determined as a function of current epoch. Epochal Difficult Captions can be used with any model architecture and is a lightweight function that does not increase training time. We test our results on three systems and show that using Epochal Difficult Captions consistently improves performance
Comments: 4 content pages, 1 reference page
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2206.01918 [cs.CL]
  (or arXiv:2206.01918v1 [cs.CL] for this version)

Submission history

From: Andrew Koh [view email]
[v1] Sat, 4 Jun 2022 06:42:05 GMT (970kb,D)

Link back to: arXiv, form interface, contact.