Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: SDGM: Sparse Bayesian Classifier Based on a Discriminative Gaussian Mixture Model
(Submitted on 14 Nov 2019 (this version), latest version 7 May 2021 (v2))
Abstract: In probabilistic classification, a discriminative model based on Gaussian mixture exhibits flexible fitting capability. Nevertheless, it is difficult to determine the number of components. We propose a sparse classifier based on a discriminative Gaussian mixture model (GMM), which is named sparse discriminative Gaussian mixture (SDGM). In the SDGM, a GMM-based discriminative model is trained by sparse Bayesian learning. This learning algorithm improves the generalization capability by obtaining a sparse solution and automatically determines the number of components by removing redundant components. The SDGM can be embedded into neural networks (NNs) such as convolutional NNs and can be trained in an end-to-end manner. Experimental results indicated that the proposed method prevented overfitting by obtaining sparsity. Furthermore, we demonstrated that the proposed method outperformed a fully connected layer with the softmax function in certain cases when it was used as the last layer of a deep NN.
Submission history
From: Hideaki Hayashi D.Eng. [view email][v1] Thu, 14 Nov 2019 10:42:41 GMT (517kb,D)
[v2] Fri, 7 May 2021 08:23:12 GMT (953kb,D)
Link back to: arXiv, form interface, contact.