We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: A Randomized Missing Data Approach to Robust Filtering and Forecasting

Abstract: We put forward a simple new randomized missing data (RMD) approach to robust filtering of state-space models, motivated by the idea that the inclusion of only a small fraction of available highly precise measurements can still extract most of the attainable efficiency gains for filtering latent states, estimating model parameters, and producing out-of-sample forecasts. In our general RMD framework we develop two alternative implementations: endogenous (RMD-N) and exogenous (RMD-X) randomization of missing data. A degree of robustness to outliers and model misspecification is achieved by purposely randomizing over the utilized subset of data measurements in their original time series order, while treating the rest as if missing. The arising robustness-efficiency trade-off is controlled by varying the fraction of randomly utilized measurements. Our RMD framework thus relates to but is different from a wide range of machine learning methods trading off bias against variance. It also provides a time-series extension of bootstrap aggregation (bagging). As an empirical illustration, we show consistently attractive performance of RMD filtering and forecasting in popular state space models for extracting inflation trends known to be hindered by measurement outliers.
Comments: 46 pages; 6 figures; 3 tables
Subjects: Methodology (stat.ME)
Cite as: arXiv:2104.14664 [stat.ME]
  (or arXiv:2104.14664v4 [stat.ME] for this version)

Submission history

From: Pawel Szerszen [view email]
[v1] Thu, 29 Apr 2021 21:17:32 GMT (852kb,D)
[v2] Tue, 4 May 2021 15:40:19 GMT (853kb,D)
[v3] Wed, 26 May 2021 21:37:29 GMT (666kb,D)
[v4] Thu, 20 Oct 2022 17:23:33 GMT (76kb,D)

Link back to: arXiv, form interface, contact.