We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Sound

Title: Language-Based Audio Retrieval with Converging Tied Layers and Contrastive Loss

Abstract: In this paper, we tackle the new Language-Based Audio Retrieval task proposed in DCASE 2022. Firstly, we introduce a simple, scalable architecture which ties both the audio and text encoder together. Secondly, we show that using this architecture along with contrastive loss allows the model to significantly beat the performance of the baseline model. Finally, in addition to having an extremely low training memory requirement, we are able to use pretrained models as it is without needing to finetune them. We test our methods and show that using a combination of our methods beats the baseline scores significantly.
Subjects: Sound (cs.SD); Computation and Language (cs.CL); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)
Cite as: arXiv:2206.14659 [cs.SD]
  (or arXiv:2206.14659v1 [cs.SD] for this version)

Submission history

From: Andrew Koh [view email]
[v1] Wed, 29 Jun 2022 13:59:19 GMT (86kb,D)

Link back to: arXiv, form interface, contact.