We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: Local Grammar-Based Coding Revisited

Abstract: We revisit the problem of minimal local grammar-based coding. In this setting, the local grammar encoder encodes grammars symbol by symbol, whereas the minimal grammar transform minimizes the grammar length in a preset class of grammars as given by the length of local grammar encoding. It is known that such minimal codes are strongly universal for a strictly positive entropy rate, whereas the number of rules in the minimal grammar constitutes an upper bound for the mutual information of the source. Whereas the fully minimal code is likely intractable, the constrained minimal block code can be efficiently computed. In this note, we present a new, simpler, and more general proof of strong universality of the minimal block code, regardless of the entropy rate. The proof is based on a simple Zipfian bound for ranked probabilities. By the way, we also show empirically that the number of rules in the minimal block code cannot clearly discriminate between long-memory and memoryless sources, such as a text in English and a random permutation of its characters. This contradicts our previous expectations.
Comments: 17 pages, 1 figure
Subjects: Information Theory (cs.IT); Computation and Language (cs.CL)
MSC classes: 94A29
Cite as: arXiv:2209.13636 [cs.IT]
  (or arXiv:2209.13636v1 [cs.IT] for this version)

Submission history

From: Łukasz Dębowski [view email]
[v1] Tue, 27 Sep 2022 19:05:22 GMT (32kb,D)

Link back to: arXiv, form interface, contact.