We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Nonlinear Sciences > Chaotic Dynamics

Title: On the non-randomness of maximum Lempel Ziv complexity sequences of finite size

Abstract: Random sequences attain the highest entropy rate. The estimation of entropy rate for an ergodic source can be done using the Lempel Ziv complexity measure yet, the exact entropy rate value is only reached in the infinite limit. We prove that typical random sequences of finite length fall short of the maximum Lempel-Ziv complexity, contrary to common belief. We discuss that, for a finite length, maximum Lempel-Ziv sequences can be built from a well defined generating algorithm, which makes them of low Kolmogorov-Chaitin complexity, quite the opposite to randomness. It will be discussed that Lempel-Ziv measure is, in this sense, less general than Kolmogorov-Chaitin complexity, as it can be fooled by an intelligent enough agent. The latter will be shown to be the case for the binary expansion of certain irrational numbers. Maximum Lempel-Ziv sequences induce a normalization that gives good estimates of entropy rate for several sources, while keeping bounded values for all sequence length, making it an alternative to other normalization schemes in use.
Subjects: Chaotic Dynamics (nlin.CD); Information Theory (cs.IT)
Journal reference: CHAOS 23, 023118 (2013)
DOI: 10.1063/1.4808251
Cite as: arXiv:1311.0546 [nlin.CD]
  (or arXiv:1311.0546v1 [nlin.CD] for this version)

Submission history

From: Ernesto Estévez-Rams [view email]
[v1] Sun, 3 Nov 2013 23:57:59 GMT (474kb)

Link back to: arXiv, form interface, contact.