References & Citations
Computer Science > Information Theory
Title: On Probability Estimation by Exponential Smoothing
(Submitted on 6 Jan 2015 (v1), last revised 9 Jan 2015 (this version, v2))
Abstract: Probability estimation is essential for every statistical data compression algorithm. In practice probability estimation should be adaptive, recent observations should receive a higher weight than older observations. We present a probability estimation method based on exponential smoothing that satisfies this requirement and runs in constant time per letter. Our main contribution is a theoretical analysis in case of a binary alphabet for various smoothing rate sequences: We show that the redundancy w.r.t. a piecewise stationary model with $s$ segments is $O\left(s\sqrt n\right)$ for any bit sequence of length $n$, an improvement over redundancy $O\left(s\sqrt{n\log n}\right)$ of previous approaches with similar time complexity.
Submission history
From: Christopher Mattern [view email][v1] Tue, 6 Jan 2015 15:31:53 GMT (75kb,D)
[v2] Fri, 9 Jan 2015 11:53:51 GMT (75kb,D)
Link back to: arXiv, form interface, contact.