We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Information Theory

Title: Sparse p-Adic Data Coding for Computationally Efficient and Effective Big Data Analytics

Authors: Fionn Murtagh
Abstract: We develop the theory and practical implementation of p-adic sparse coding of data. Rather than the standard, sparsifying criterion that uses the $L_0$ pseudo-norm, we use the p-adic norm. We require that the hierarchy or tree be node-ranked, as is standard practice in agglomerative and other hierarchical clustering, but not necessarily with decision trees. In order to structure the data, all computational processing operations are direct reading of the data, or are bounded by a constant number of direct readings of the data, implying linear computational time. Through p-adic sparse data coding, efficient storage results, and for bounded p-adic norm stored data, search and retrieval are constant time operations. Examples show the effectiveness of this new approach to content-driven encoding and displaying of data.
Comments: 20 pages, 6 figures
Subjects: Information Theory (cs.IT)
MSC classes: 94B27, 62H30, 68P01
ACM classes: E.2; E.4; G.2.2; H.3.3
Journal reference: p-Adic Numbers, Ultrametric Analysis and Applications, 8(3), 2016, pp. 236-247
DOI: 10.1134/S2070046616030055
Cite as: arXiv:1604.06961 [cs.IT]
  (or arXiv:1604.06961v1 [cs.IT] for this version)

Submission history

From: Fionn Murtagh [view email]
[v1] Sat, 23 Apr 2016 22:28:00 GMT (376kb,D)

Link back to: arXiv, form interface, contact.