References & Citations
Computer Science > Information Theory
Title: Forest Learning from Data and its Universal Coding
(Submitted on 1 Aug 2018 (v1), last revised 3 Aug 2018 (this version, v2))
Abstract: This paper considers structure learning from data with $n$ samples of $p$ variables, assuming that the structure is a forest, using the Chow-Liu algorithm. Specifically, for incomplete data, we construct two model selection algorithms that complete in $O(p^2)$ steps: one obtains a forest with the maximum posterior probability given the data, and the other obtains a forest that converges to the true one as $n$ increases. We show that the two forests are generally different when some values are missing. Additionally, we present estimations for benchmark data sets to demonstrate that both algorithms work in realistic situations. Moreover, we derive the conditional entropy provided that no value is missing, and we evaluate the per-sample expected redundancy for the universal coding of incomplete data in terms of the number of non-missing samples.
Submission history
From: Joe Suzuki [view email][v1] Wed, 1 Aug 2018 21:05:49 GMT (153kb,D)
[v2] Fri, 3 Aug 2018 00:57:15 GMT (153kb,D)
Link back to: arXiv, form interface, contact.