We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Composable Models for Online Bayesian Analysis of Streaming Data

Abstract: Data is rapidly increasing in volume and velocity and the Internet of Things (IoT) is one important source of this data. The IoT is a collection of connected devices (things) which are constantly recording data from their surroundings using on-board sensors. These devices can record and stream data to the cloud at a very high rate, leading to high storage and analysis costs. In order to ameliorate these costs, we can analyse the data as it arrives in a stream to learn about the underlying process, perform interpolation and smoothing and make forecasts and predictions.
Conventional tools of state space modelling assume data on a fixed regular time grid. However, many sensors change their sampling frequency, sometimes adaptively, or get interrupted and re-started out of sync with the previous sampling grid, or just generate event data at irregular times. It is therefore desirable to model the system as a partially and irregularly observed Markov process which evolves in continuous time. Both the process and the observation model are potentially non-linear. Particle filters therefore represent the simplest approach to online analysis. A functional Scala library of composable continuous time Markov process models has been developed in order to model the wide variety of data captured in the IoT.
Comments: 25 pages, 11 figures. For associated code repository, see this http URL
Subjects: Methodology (stat.ME)
Cite as: arXiv:1609.00635 [stat.ME]
  (or arXiv:1609.00635v1 [stat.ME] for this version)

Submission history

From: Jonathan Law [view email]
[v1] Fri, 2 Sep 2016 14:58:25 GMT (378kb,D)

Link back to: arXiv, form interface, contact.