Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Robust importance-weighted cross-validation under sample selection bias
(Submitted on 17 Oct 2017 (v1), last revised 27 Aug 2019 (this version, v3))
Abstract: Cross-validation under sample selection bias can, in principle, be done by importance-weighting the empirical risk. However, the importance-weighted risk estimator produces sub-optimal hyperparameter estimates in problem settings where large weights arise with high probability. We study its sampling variance as a function of the training data distribution and introduce a control variate to increase its robustness to problematically large weights.
Submission history
From: Wouter Kouw [view email][v1] Tue, 17 Oct 2017 22:10:07 GMT (243kb)
[v2] Mon, 24 Dec 2018 14:27:57 GMT (282kb)
[v3] Tue, 27 Aug 2019 10:56:45 GMT (188kb)
Link back to: arXiv, form interface, contact.