We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: Worst-risk minimization in generalized structural equation models

Abstract: We consider rather general structural equation models (SEMs) between a target and its covariates in several shifted environments. Given $k\in\N$ shifts we consider the set of shifts that are at most $\gamma$-times as strong as a given weighted linear combination of these $k$ shifts and the worst (quadratic) risk over this entire space. This worst risk has a nice decomposition which we refer to as the "worst risk decomposition". Then we find an explicit arg-min solution that minimizes the worst risk and consider its corresponding plug-in estimator which is the main object of this paper. This plug-in estimator is (almost surely) consistent and we first prove a concentration in measure result for it. The solution to the worst risk minimizer is rather reminiscent of the corresponding ordinary least squares solution in that it is product of a vector and an inverse of a Grammian matrix. Due to this, the central moments of the plug-in estimator is not well-defined in general, but we instead consider these moments conditioned on the Grammian inverse being bounded by some given constant. We also study conditional variance of the estimator with respect to a natural filtration for the incoming data. Similarly we consider the conditional covariance matrix with respect to this filtration and prove a bound for the determinant of this matrix. This SEM model generalizes the linear models that have been studied previously for instance in the setting of casual inference or anchor regression but the concentration in measure result and the moment bounds are new even in the linear setting.
Subjects: Statistics Theory (math.ST); Probability (math.PR)
MSC classes: 62G05
Cite as: arXiv:2306.03588 [math.ST]
  (or arXiv:2306.03588v4 [math.ST] for this version)

Submission history

From: Philip Kennerberg [view email]
[v1] Tue, 6 Jun 2023 11:14:15 GMT (319kb,D)
[v2] Thu, 27 Jul 2023 12:04:42 GMT (34kb)
[v3] Tue, 15 Aug 2023 02:28:33 GMT (35kb)
[v4] Mon, 9 Oct 2023 13:53:54 GMT (37kb)

Link back to: arXiv, form interface, contact.