Current browse context:
cs.IT
Change to browse by:
References & Citations
Computer Science > Information Theory
Title: Sampling Requirements for Stable Autoregressive Estimation
(Submitted on 4 May 2016 (this version), latest version 17 Jan 2017 (v2))
Abstract: We consider the problem of estimating the parameters of a linear autoregressive model with sub-Gaussian innovations from a limited sequence of consecutive observations. Assuming that the parameters are compressible, we analyze the performance of the $\ell_1$-regularized least squares as well as a greedy estimator of the parameters and characterize the sampling trade-offs required for stable recovery in the non-asymptotic regime. Our results extend those of compressed sensing for linear models where the covariates are i.i.d. and independent of the observation history to autoregressive processes with highly inter-dependent covariates. We also derive sufficient conditions on the sparsity level that guarantee the minimax optimality of the $\ell_1$-regularized least squares estimate. Applying these techniques to simulated data as well as real-world datasets from crude oil prices and traffic speed data confirm our predicted theoretical performance gains in terms of estimation accuracy and model selection.
Submission history
From: Behtash Babadi [view email][v1] Wed, 4 May 2016 21:07:04 GMT (1486kb)
[v2] Tue, 17 Jan 2017 19:22:02 GMT (1653kb)
Link back to: arXiv, form interface, contact.