Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Classifier comparison using precision
(Submitted on 29 Sep 2016 (v1), last revised 16 Nov 2016 (this version, v2))
Abstract: New proposed models are often compared to state-of-the-art using statistical significance testing. Literature is scarce for classifier comparison using metrics other than accuracy. We present a survey of statistical methods that can be used for classifier comparison using precision, accounting for inter-precision correlation arising from use of same dataset. Comparisons are made using per-class precision and methods presented to test global null hypothesis of an overall model comparison. Comparisons are extended to multiple multi-class classifiers and to models using cross validation or its variants. Partial Bayesian update to precision is introduced when population prevalence of a class is known. Applications to compare deep architectures are studied.
Submission history
From: Lovedeep Gondara [view email][v1] Thu, 29 Sep 2016 19:19:29 GMT (90kb,D)
[v2] Wed, 16 Nov 2016 01:43:21 GMT (151kb,D)
Link back to: arXiv, form interface, contact.