We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: The Metagenomic Binning Problem: Clustering Markov Sequences

Abstract: The goal of metagenomics is to study the composition of microbial communities, typically using high-throughput shotgun sequencing. In the metagenomic binning problem, we observe random substrings (called contigs) from a mixture of genomes and want to cluster them according to their genome of origin. Based on the empirical observation that genomes of different bacterial species can be distinguished based on their tetranucleotide frequencies, we model this task as the problem of clustering N sequences generated by M distinct Markov processes, where M<<N. Utilizing the large-deviation principle for Markov processes, we establish the information-theoretic limit for perfect binning. Specifically, we show that the length of the contigs must scale with the inverse of the Chernoff Information between the two most similar species. Our result also implies that contigs should be binned using the conditional relative entropy as a measure of distance, as opposed to the Euclidean distance often used in practice.
Comments: IEEE-ITW 2019 Proceedings, 9 pages, 3 figures
Subjects: Information Theory (cs.IT)
Cite as: arXiv:1912.05741 [cs.IT]
  (or arXiv:1912.05741v1 [cs.IT] for this version)

Submission history

From: Grant Greenberg [view email]
[v1] Thu, 12 Dec 2019 02:34:55 GMT (123kb,D)

Link back to: arXiv, form interface, contact.