We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Context-tree weighting for real-valued time series: Bayesian inference with hierarchical mixture models

Abstract: Real-valued time series are ubiquitous in the sciences and engineering. In this work, a general, hierarchical Bayesian modelling framework is developed for building mixture models for times series. This development is based, in part, on the use of context trees, and it includes a collection of effective algorithmic tools for learning and inference. A discrete context (or 'state') is extracted for each sample, consisting of a discretised version of some of the most recent observations preceding it. The set of all relevant contexts are represented as a discrete context-tree. At the bottom level, a different real-valued time series model is associated with each context-state, i.e., with each leaf of the tree. This defines a very general framework that can be used in conjunction with any existing model class to build flexible and interpretable mixture models. Extending the idea of context-tree weighting leads to algorithms that allow for efficient, exact Bayesian inference in this setting. The utility of the general framework is illustrated in detail when autoregressive (AR) models are used at the bottom level, resulting in a nonlinear AR mixture model. The associated methods are found to outperform several state-of-the-art techniques on simulated and real-world experiments.
Subjects: Methodology (stat.ME); Applications (stat.AP); Machine Learning (stat.ML)
Cite as: arXiv:2106.03023 [stat.ME]
  (or arXiv:2106.03023v4 [stat.ME] for this version)

Submission history

From: Ioannis Papageorgiou [view email]
[v1] Sun, 6 Jun 2021 03:46:49 GMT (66kb,D)
[v2] Thu, 3 Feb 2022 00:44:06 GMT (82kb,D)
[v3] Fri, 20 May 2022 15:55:04 GMT (96kb,D)
[v4] Sat, 15 Apr 2023 02:14:38 GMT (46kb,D)

Link back to: arXiv, form interface, contact.