References & Citations
Statistics > Machine Learning
Title: Semi-supervised Learning based on Distributionally Robust Optimization
(Submitted on 28 Feb 2017 (v1), last revised 21 Mar 2019 (this version, v4))
Abstract: We propose a novel method for semi-supervised learning (SSL) based on data-driven distributionally robust optimization (DRO) using optimal transport metrics. Our proposed method enhances generalization error by using the unlabeled data to restrict the support of the worst case distribution in our DRO formulation. We enable the implementation of our DRO formulation by proposing a stochastic gradient descent algorithm which allows to easily implement the training procedure. We demonstrate that our Semi-supervised DRO method is able to improve the generalization error over natural supervised procedures and state-of-the-art SSL estimators. Finally, we include a discussion on the large sample behavior of the optimal uncertainty region in the DRO formulation. Our discussion exposes important aspects such as the role of dimension reduction in SSL.
Submission history
From: Yang Kang [view email][v1] Tue, 28 Feb 2017 16:30:17 GMT (777kb,D)
[v2] Fri, 19 May 2017 20:36:19 GMT (449kb,D)
[v3] Fri, 4 Aug 2017 13:21:19 GMT (730kb,D)
[v4] Thu, 21 Mar 2019 02:04:54 GMT (772kb,D)
Link back to: arXiv, form interface, contact.