Current browse context:
cs.CL
Change to browse by:
References & Citations
Computer Science > Computation and Language
Title: MMER: Multimodal Multi-task Learning for Speech Emotion Recognition
(Submitted on 31 Mar 2022 (v1), last revised 3 Jun 2023 (this version, v5))
Abstract: In this paper, we propose MMER, a novel Multimodal Multi-task learning approach for Speech Emotion Recognition. MMER leverages a novel multimodal network based on early-fusion and cross-modal self-attention between text and acoustic modalities and solves three novel auxiliary tasks for learning emotion recognition from spoken utterances. In practice, MMER outperforms all our baselines and achieves state-of-the-art performance on the IEMOCAP benchmark. Additionally, we conduct extensive ablation studies and results analysis to prove the effectiveness of our proposed approach.
Submission history
From: Sreyan Ghosh [view email][v1] Thu, 31 Mar 2022 04:51:32 GMT (312kb,D)
[v2] Fri, 1 Apr 2022 04:39:53 GMT (312kb,D)
[v3] Thu, 18 Aug 2022 15:12:39 GMT (312kb,D)
[v4] Mon, 31 Oct 2022 21:51:49 GMT (1446kb,D)
[v5] Sat, 3 Jun 2023 21:55:28 GMT (711kb,D)
Link back to: arXiv, form interface, contact.