We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Optimization and Control

Title: Admissibility of solution estimators for stochastic optimization

Abstract: We look at stochastic optimization problems through the lens of statistical decision theory. In particular, we address admissibility, in the statistical decision theory sense, of the natural sample average estimator for a stochastic optimization problem (which is also known as the empirical risk minimization (ERM) rule in learning literature). It is well known that for some simple stochastic optimization problems, the sample average estimator may not be admissible. This is known as {\em Stein's paradox} in the statistics literature. We show in this paper that for optimizing stochastic linear functions over compact sets, the sample average estimator is admissible. Moreover, we study problems with convex quadratic objectives subject to box constraints. Stein's paradox holds when there are no constraints and the dimension of the problem is at least three. We show that in the presence of box constraints, admissibility is recovered for dimensions 3 and 4.
Subjects: Optimization and Control (math.OC); Statistics Theory (math.ST)
MSC classes: 90C15, 62C15, 62F10
Cite as: arXiv:1901.06976 [math.OC]
  (or arXiv:1901.06976v6 [math.OC] for this version)

Submission history

From: Amitabh Basu [view email]
[v1] Mon, 21 Jan 2019 15:55:13 GMT (13kb)
[v2] Wed, 23 Jan 2019 17:33:57 GMT (13kb)
[v3] Sat, 5 Oct 2019 18:27:08 GMT (54kb,D)
[v4] Sat, 23 May 2020 19:18:56 GMT (57kb,D)
[v5] Fri, 18 Sep 2020 19:26:54 GMT (57kb,D)
[v6] Wed, 21 Oct 2020 20:56:58 GMT (57kb,D)

Link back to: arXiv, form interface, contact.