We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Transfer Learning in Conversational Analysis through Reusing Preprocessing Data as Supervisors

Abstract: Conversational analysis systems are trained using noisy human labels and often require heavy preprocessing during multi-modal feature extraction. Using noisy labels in single-task learning increases the risk of over-fitting. Auxiliary tasks could improve the performance of the primary task learning during the same training -- this approach sits in the intersection of transfer learning and multi-task learning (MTL). In this paper, we explore how the preprocessed data used for feature engineering can be re-used as auxiliary tasks, thereby promoting the productive use of data. Our main contributions are: (1) the identification of sixteen beneficially auxiliary tasks, (2) studying the method of distributing learning capacity between the primary and auxiliary tasks, and (3) studying the relative supervision hierarchy between the primary and auxiliary tasks. Extensive experiments on IEMOCAP and SEMAINE data validate the improvements over single-task approaches, and suggest that it may generalize across multiple primary tasks.
Comments: 16 pages
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)
ACM classes: I.2.6
Cite as: arXiv:2112.03032 [cs.CL]
  (or arXiv:2112.03032v1 [cs.CL] for this version)

Submission history

From: Joshua Kim [view email]
[v1] Thu, 2 Dec 2021 08:40:42 GMT (227kb,D)

Link back to: arXiv, form interface, contact.