Current browse context:
stat.CO
Change to browse by:
References & Citations
Statistics > Computation
Title: Computation of conditional expectations with guarantees
(Submitted on 3 Dec 2021 (v1), last revised 21 Feb 2023 (this version, v3))
Abstract: Theoretically, the conditional expectation of a square-integrable random variable $Y$ given a $d$-dimensional random vector $X$ can be obtained by minimizing the mean squared distance between $Y$ and $f(X)$ over all Borel measurable functions $f \colon \mathbb{R}^d \to \mathbb{R}$. However, in many applications this minimization problem cannot be solved exactly, and instead, a numerical method which computes an approximate minimum over a suitable subfamily of Borel functions has to be used. The quality of the result depends on the adequacy of the subfamily and the performance of the numerical method. In this paper, we derive an expected value representation of the minimal mean squared distance which in many applications can efficiently be approximated with a standard Monte Carlo average. This enables us to provide guarantees for the accuracy of any numerical approximation of a given conditional expectation. We illustrate the method by assessing the quality of approximate conditional expectations obtained by linear, polynomial and neural network regression in different concrete examples.
Submission history
From: Patrick Cheridito [view email][v1] Fri, 3 Dec 2021 09:26:28 GMT (24kb)
[v2] Fri, 23 Dec 2022 20:36:32 GMT (25kb)
[v3] Tue, 21 Feb 2023 08:18:51 GMT (25kb)
Link back to: arXiv, form interface, contact.