Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Probabilistic Feature Selection and Classification Vector Machine
(Submitted on 18 Sep 2016 (v1), last revised 13 Jun 2018 (this version, v3))
Abstract: Sparse Bayesian learning is a state-of-the-art supervised learning algorithm that can choose a subset of relevant samples from the input data and make reliable probabilistic predictions. However, in the presence of high-dimensional data with irrelevant features, traditional sparse Bayesian classifiers suffer from performance degradation and low efficiency by failing to eliminate irrelevant features. To tackle this problem, we propose a novel sparse Bayesian embedded feature selection method that adopts truncated Gaussian distributions as both sample and feature priors. The proposed method, called probabilistic feature selection and classification vector machine (PFCVMLP ), is able to simultaneously select relevant features and samples for classification tasks. In order to derive the analytical solutions, Laplace approximation is applied to compute approximate posteriors and marginal likelihoods. Finally, parameters and hyperparameters are optimized by the type-II maximum likelihood method. Experiments on three datasets validate the performance of PFCVMLP along two dimensions: classification performance and effectiveness for feature selection. Finally, we analyze the generalization performance and derive a generalization error bound for PFCVMLP . By tightening the bound, the importance of feature selection is demonstrated.
Submission history
From: Chang Li Mr. [view email][v1] Sun, 18 Sep 2016 14:01:04 GMT (818kb,D)
[v2] Mon, 2 Jan 2017 13:36:44 GMT (1104kb,D)
[v3] Wed, 13 Jun 2018 10:10:48 GMT (2236kb,D)
Link back to: arXiv, form interface, contact.