We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.IT

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Information Theory

Title: Sampling Requirements for Stable Autoregressive Estimation

Abstract: We consider the problem of estimating the parameters of a linear univariate autoregressive model with sub-Gaussian innovations from a limited sequence of consecutive observations. Assuming that the parameters are compressible, we analyze the performance of the $\ell_1$-regularized least squares as well as a greedy estimator of the parameters and characterize the sampling trade-offs required for stable recovery in the non-asymptotic regime. In particular, we show that for a fixed sparsity level, stable recovery of AR parameters is possible when the number of samples scale sub-linearly with the AR order. Our results improve over existing sampling complexity requirements in AR estimation using the LASSO, when the sparsity level scales faster than the square root of the model order. We further derive sufficient conditions on the sparsity level that guarantee the minimax optimality of the $\ell_1$-regularized least squares estimate. Applying these techniques to simulated data as well as real-world datasets from crude oil prices and traffic speed data confirm our predicted theoretical performance gains in terms of estimation accuracy and model selection.
Subjects: Information Theory (cs.IT); Discrete Mathematics (cs.DM); Optimization and Control (math.OC); Methodology (stat.ME); Machine Learning (stat.ML)
DOI: 10.1109/TSP.2017.2656848
Cite as: arXiv:1605.01436 [cs.IT]
  (or arXiv:1605.01436v2 [cs.IT] for this version)

Submission history

From: Behtash Babadi [view email]
[v1] Wed, 4 May 2016 21:07:04 GMT (1486kb)
[v2] Tue, 17 Jan 2017 19:22:02 GMT (1653kb)

Link back to: arXiv, form interface, contact.