We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Sparsity-driven weighted ensemble classifier

Abstract: In this study, a novel sparsity-driven weighted ensemble classifier (SDWEC) that improves classification accuracy and minimizes the number of classifiers is proposed. Using pre-trained classifiers, an ensemble in which base classifiers votes according to assigned weights is formed. These assigned weights directly affect classifier accuracy. In the proposed method, ensemble weights finding problem is modeled as a cost function with the following terms: (a) a data fidelity term aiming to decrease misclassification rate, (b) a sparsity term aiming to decrease the number of classifiers, and (c) a non-negativity constraint on the weights of the classifiers. As the proposed cost function is non-convex thus hard to solve, convex relaxation techniques and novel approximations are employed to obtain a numerically efficient solution. Sparsity term of cost function allows trade-off between accuracy and testing time when needed. The efficiency of SDWEC was tested on 11 datasets and compared with the state-of-the art classifier ensemble methods. The results show that SDWEC provides better or similar accuracy levels using fewer classifiers and reduces testing time for ensemble.
Comments: Last version updated according to journal version but not edited by journal
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
Journal reference: International Journal of Computational Intelligence Systems, 2018
DOI: 10.2991/ijcis.11.1.73
Cite as: arXiv:1610.00270 [stat.ML]
  (or arXiv:1610.00270v3 [stat.ML] for this version)

Submission history

From: Atilla Ozgur [view email]
[v1] Sun, 2 Oct 2016 12:33:48 GMT (437kb,D)
[v2] Thu, 17 Nov 2016 11:16:46 GMT (597kb,D)
[v3] Fri, 21 Jun 2019 19:25:38 GMT (1404kb,D)

Link back to: arXiv, form interface, contact.