Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: An analytic formulation for positive-unlabeled learning via weighted integral probability metric
(Submitted on 28 Jan 2019 (v1), revised 8 Feb 2019 (this version, v2), latest version 20 Feb 2020 (v6))
Abstract: We consider the problem of learning a binary classifier from only positive and unlabeled observations (PU learning). Although recent research in PU learning has succeeded in showing theoretical and empirical performance, most existing algorithms need to solve either a convex or a non-convex optimization problem and thus are not suitable for large-scale datasets. In this paper, we propose a simple yet theoretically grounded PU learning algorithm by extending the previous work proposed for supervised binary classification (Sriperumbudur et al., 2012). The proposed PU learning algorithm produces a closed-form classifier when the hypothesis space is a closed ball in reproducing kernel Hilbert space. In addition, we establish upper bounds of the estimation error and the excess risk. The obtained estimation error bound is sharper than existing results and the excess risk bound does not rely on an approximation error term. To the best of our knowledge, we are the first to explicitly derive the excess risk bound in the field of PU learning. Finally, we conduct extensive numerical experiments using both synthetic and real datasets, demonstrating improved accuracy, scalability, and robustness of the proposed algorithm.
Submission history
From: Yongchan Kwon [view email][v1] Mon, 28 Jan 2019 03:47:43 GMT (323kb,D)
[v2] Fri, 8 Feb 2019 09:35:32 GMT (324kb,D)
[v3] Wed, 1 May 2019 09:24:56 GMT (329kb,D)
[v4] Fri, 3 May 2019 16:42:55 GMT (331kb,D)
[v5] Sat, 6 Jul 2019 07:16:09 GMT (803kb,D)
[v6] Thu, 20 Feb 2020 04:03:03 GMT (781kb,D)
Link back to: arXiv, form interface, contact.