We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Information Theory

Title: Forest Learning from Data and its Universal Coding

Authors: Joe Suzuki
Abstract: This paper considers structure learning from data with $n$ samples of $p$ variables, assuming that the structure is a forest, using the Chow-Liu algorithm. Specifically, for incomplete data, we construct two model selection algorithms that complete in $O(p^2)$ steps: one obtains a forest with the maximum posterior probability given the data, and the other obtains a forest that converges to the true one as $n$ increases. We show that the two forests are generally different when some values are missing. Additionally, we present estimations for benchmark data sets to demonstrate that both algorithms work in realistic situations. Moreover, we derive the conditional entropy provided that no value is missing, and we evaluate the per-sample expected redundancy for the universal coding of incomplete data in terms of the number of non-missing samples.
Subjects: Information Theory (cs.IT)
Journal reference: IEEE Transactions on Information Theory 2018
Cite as: arXiv:1808.00566 [cs.IT]
  (or arXiv:1808.00566v2 [cs.IT] for this version)

Submission history

From: Joe Suzuki [view email]
[v1] Wed, 1 Aug 2018 21:05:49 GMT (153kb,D)
[v2] Fri, 3 Aug 2018 00:57:15 GMT (153kb,D)

Link back to: arXiv, form interface, contact.