Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Learning Interpretable Characteristic Kernels via Decision Forests
(Submitted on 30 Nov 2018 (v1), revised 11 Sep 2020 (this version, v2), latest version 28 Sep 2023 (v3))
Abstract: Decision forests are popular tools for classification and regression. These forests naturally produce proximity matrices measuring how often each pair of observations lies in the same leaf node. It has been demonstrated that these proximity matrices can be thought of as kernels, connecting the decision forest literature to the extensive kernel machine literature. While other kernels are known to have strong theoretical properties such as being characteristic, no similar result is available for any decision forest based kernel. In this manuscript,we prove that the decision forest induced proximity can be made characteristic, which can be used to yield a universally consistent statistic for testing independence. We demonstrate the performance of the induced kernel on a suite of 20 high-dimensional independence test settings. We also show how this learning kernel offers insights into relative feature importance. The decision forest induced kernel typically achieves substantially higher testing power than existing popular methods in statistical tests.
Submission history
From: Sambit Panda [view email][v1] Fri, 30 Nov 2018 19:31:17 GMT (29kb,D)
[v2] Fri, 11 Sep 2020 16:46:38 GMT (492kb,D)
[v3] Thu, 28 Sep 2023 17:47:08 GMT (1301kb,D)
Link back to: arXiv, form interface, contact.