We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Electrical Engineering and Systems Science > Signal Processing

Title: Minimax Estimation of Partially-Observed Vector AutoRegressions

Authors: Guillaume Dalle (CERMICS), Yohann de Castro (ICJ, ECL)
Abstract: High-dimensional time series are a core ingredient of the statistical modeling toolkit, for which numerous estimation methods are known.But when observations are scarce or corrupted, the learning task becomes much harder.The question is: how much harder? In this paper, we study the properties of a partially-observed Vector AutoRegressive process, which is a state-space model endowed with a stochastic observation mechanism.Our goal is to estimate its sparse transition matrix, but we only have access to a small and noisy subsample of the state components.Interestingly, the sampling process itself is random and can exhibit temporal correlations, a feature shared by many realistic data acquisition scenarios.We start by describing an estimator based on the Yule-Walker equation and the Dantzig selector, and we give an upper bound on its non-asymptotic error.Then, we provide a matching minimax lower bound, thus proving near-optimality of our estimator.The convergence rate we obtain sheds light on the role of several key parameters such as the sampling ratio, the amount of noise and the number of non-zero coefficients in the transition matrix.These theoretical findings are commented and illustrated by numerical experiments on simulated data.
Subjects: Signal Processing (eess.SP); Statistics Theory (math.ST); Methodology (stat.ME); Machine Learning (stat.ML)
Cite as: arXiv:2106.09327 [eess.SP]
  (or arXiv:2106.09327v3 [eess.SP] for this version)

Submission history

From: Guillaume Dalle [view email]
[v1] Thu, 17 Jun 2021 08:46:53 GMT (240kb,D)
[v2] Wed, 4 May 2022 07:54:15 GMT (275kb,D)
[v3] Thu, 5 May 2022 09:04:04 GMT (275kb,D)

Link back to: arXiv, form interface, contact.