Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Theoretical Evaluation of Feature Selection Methods based on Mutual Information
(Submitted on 21 Sep 2016 (v1), last revised 7 Oct 2016 (this version, v2))
Abstract: Feature selection methods are usually evaluated by wrapping specific classifiers and datasets in the evaluation process, resulting very often in unfair comparisons between methods. In this work, we develop a theoretical framework that allows obtaining the true feature ordering of two-dimensional sequential forward feature selection methods based on mutual information, which is independent of entropy or mutual information estimation methods, classifiers, or datasets, and leads to an undoubtful comparison of the methods. Moreover, the theoretical framework unveils problems intrinsic to some methods that are otherwise difficult to detect, namely inconsistencies in the construction of the objective function used to select the candidate features, due to various types of indeterminations and to the possibility of the entropy of continuous random variables taking null and negative values.
Submission history
From: M. Rosário Oliveira [view email][v1] Wed, 21 Sep 2016 14:23:15 GMT (47kb,D)
[v2] Fri, 7 Oct 2016 22:51:50 GMT (49kb,D)
Link back to: arXiv, form interface, contact.