Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Accelerating Cross-Validation in Multinomial Logistic Regression with $\ell_1$-Regularization
(Submitted on 15 Nov 2017 (v1), last revised 18 Sep 2018 (this version, v2))
Abstract: We develop an approximate formula for evaluating a cross-validation estimator of predictive likelihood for multinomial logistic regression regularized by an $\ell_1$-norm. This allows us to avoid repeated optimizations required for literally conducting cross-validation; hence, the computational time can be significantly reduced. The formula is derived through a perturbative approach employing the largeness of the data size and the model dimensionality. An extension to the elastic net regularization is also addressed. The usefulness of the approximate formula is demonstrated on simulated data and the ISOLET dataset from the UCI machine learning repository.
Submission history
From: Tomoyuki Obuchi [view email][v1] Wed, 15 Nov 2017 06:02:30 GMT (244kb)
[v2] Tue, 18 Sep 2018 15:49:22 GMT (1218kb)
Link back to: arXiv, form interface, contact.