We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: Robust nearest-neighbor methods for classifying high-dimensional data

Abstract: We suggest a robust nearest-neighbor approach to classifying high-dimensional data. The method enhances sensitivity by employing a threshold and truncates to a sequence of zeros and ones in order to reduce the deleterious impact of heavy-tailed data. Empirical rules are suggested for choosing the threshold. They require the bare minimum of data; only one data vector is needed from each population. Theoretical and numerical aspects of performance are explored, paying particular attention to the impacts of correlation and heterogeneity among data components. On the theoretical side, it is shown that our truncated, thresholded, nearest-neighbor classifier enjoys the same classification boundary as more conventional, nonrobust approaches, which require finite moments in order to achieve good performance. In particular, the greater robustness of our approach does not come at the price of reduced effectiveness. Moreover, when both training sample sizes equal 1, our new method can have performance equal to that of optimal classifiers that require independent and identically distributed data with known marginal distributions; yet, our classifier does not itself need conditions of this type.
Comments: Published in at this http URL the Annals of Statistics (this http URL) by the Institute of Mathematical Statistics (this http URL)
Subjects: Statistics Theory (math.ST)
MSC classes: 62H30 (Primary)
Journal reference: Annals of Statistics 2009, Vol. 37, No. 6A, 3186-3203
DOI: 10.1214/08-AOS591
Report number: IMS-AOS-AOS591
Cite as: arXiv:0909.0184 [math.ST]
  (or arXiv:0909.0184v1 [math.ST] for this version)

Submission history

From: Yao-ban Chan [view email]
[v1] Tue, 1 Sep 2009 13:50:20 GMT (149kb,S)

Link back to: arXiv, form interface, contact.