References & Citations
Computer Science > Machine Learning
Title: E-ADDA: Unsupervised Adversarial Domain Adaptation Enhanced by a New Mahalanobis Distance Loss for Smart Computing
(Submitted on 24 Jan 2022 (v1), last revised 21 Apr 2023 (this version, v5))
Abstract: In smart computing, the labels of training samples for a specific task are not always abundant. However, the labels of samples in a relevant but different dataset are available. As a result, researchers have relied on unsupervised domain adaptation to leverage the labels in a dataset (the source domain) to perform better classification in a different, unlabeled dataset (target domain). Existing non-generative adversarial solutions for UDA aim at achieving domain confusion through adversarial training. The ideal scenario is that perfect domain confusion is achieved, but this is not guaranteed to be true. To further enforce domain confusion on top of the adversarial training, we propose a novel UDA algorithm, \textit{E-ADDA}, which uses both a novel variation of the Mahalanobis distance loss and an out-of-distribution detection subroutine. The Mahalanobis distance loss minimizes the distribution-wise distance between the encoded target samples and the distribution of the source domain, thus enforcing additional domain confusion on top of adversarial training. Then, the OOD subroutine further eliminates samples on which the domain confusion is unsuccessful. We have performed extensive and comprehensive evaluations of E-ADDA in the acoustic and computer vision modalities. In the acoustic modality, E-ADDA outperforms several state-of-the-art UDA algorithms by up to 29.8%, measured in the f1 score. In the computer vision modality, the evaluation results suggest that we achieve new state-of-the-art performance on popular UDA benchmarks such as Office-31 and Office-Home, outperforming the second best-performing algorithms by up to 17.9%.
Submission history
From: Ye Gao [view email][v1] Mon, 24 Jan 2022 23:20:55 GMT (916kb,D)
[v2] Wed, 16 Feb 2022 10:51:08 GMT (917kb,D)
[v3] Mon, 15 Aug 2022 04:21:10 GMT (919kb,D)
[v4] Wed, 9 Nov 2022 22:36:31 GMT (986kb,D)
[v5] Fri, 21 Apr 2023 15:53:46 GMT (389kb,D)
Link back to: arXiv, form interface, contact.