Current browse context:
math.ST
Change to browse by:
References & Citations
Mathematics > Statistics Theory
Title: Fast and Bayes-consistent nearest neighbors
(Submitted on 7 Oct 2019 (v1), last revised 15 Apr 2020 (this version, v3))
Abstract: Research on nearest-neighbor methods tends to focus somewhat dichotomously either on the statistical or the computational aspects -- either on, say, Bayes consistency and rates of convergence or on techniques for speeding up the proximity search. This paper aims at bridging these realms: to reap the advantages of fast evaluation time while maintaining Bayes consistency, and further without sacrificing too much in the risk decay rate. We combine the locality-sensitive hashing (LSH) technique with a novel missing-mass argument to obtain a fast and Bayes-consistent classifier. Our algorithm's prediction runtime compares favorably against state of the art approximate NN methods, while maintaining Bayes-consistency and attaining rates comparable to minimax. On samples of size $n$ in $\R^d$, our pre-processing phase has runtime $O(d n \log n)$, while the evaluation phase has runtime $O(d\log n)$ per query point.
Submission history
From: Aryeh Kontorovich [view email][v1] Mon, 7 Oct 2019 19:46:37 GMT (19kb)
[v2] Wed, 19 Feb 2020 21:15:47 GMT (19kb)
[v3] Wed, 15 Apr 2020 21:46:51 GMT (19kb)
Link back to: arXiv, form interface, contact.