Current browse context:
stat
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Asymptotic Analysis of Objectives based on Fisher Information in Active Learning
(Submitted on 27 May 2016 (v1), last revised 14 Oct 2016 (this version, v2))
Abstract: Obtaining labels can be costly and time-consuming. Active learning allows a learning algorithm to intelligently query samples to be labeled for efficient learning. Fisher information ratio (FIR) has been used as an objective for selecting queries in active learning. However, little is known about the theory behind the use of FIR for active learning. There is a gap between the underlying theory and the motivation of its usage in practice. In this paper, we attempt to fill this gap and provide a rigorous framework for analyzing existing FIR-based active learning methods. In particular, we show that FIR can be asymptotically viewed as an upper bound of the expected variance of the log-likelihood ratio. Additionally, our analysis suggests a unifying framework that not only enables us to make theoretical comparisons among the existing querying methods based on FIR, but also allows us to give insight into the development of new active learning approaches based on this objective.
Submission history
From: Jamshid Sourati [view email][v1] Fri, 27 May 2016 20:44:28 GMT (36kb)
[v2] Fri, 14 Oct 2016 21:09:35 GMT (40kb)
Link back to: arXiv, form interface, contact.