We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Algorithms for stochastic optimization with functional or expectation constraints

Abstract: This paper considers the problem of minimizing an expectation function over a closed convex set, coupled with a {\color{black} functional or expectation} constraint on either decision variables or problem parameters. We first present a new stochastic approximation (SA) type algorithm, namely the cooperative SA (CSA), to handle problems with the constraint on devision variables. We show that this algorithm exhibits the optimal ${\cal O}(1/\epsilon^2)$ rate of convergence, in terms of both optimality gap and constraint violation, when the objective and constraint functions are generally convex, where $\epsilon$ denotes the optimality gap and infeasibility. Moreover, we show that this rate of convergence can be improved to ${\cal O}(1/\epsilon)$ if the objective and constraint functions are strongly convex. We then present a variant of CSA, namely the cooperative stochastic parameter approximation (CSPA) algorithm, to deal with the situation when the constraint is defined over problem parameters and show that it exhibits similar optimal rate of convergence to CSA. It is worth noting that CSA and CSPA are primal methods which do not require the iterations on the dual space and/or the estimation on the size of the dual variables. To the best of our knowledge, this is the first time that such optimal SA methods for solving functional or expectation constrained stochastic optimization are presented in the literature.
Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)
Cite as: arXiv:1604.03887 [math.OC]
  (or arXiv:1604.03887v7 [math.OC] for this version)

Submission history

From: Zhiqiang Zhou [view email]
[v1] Wed, 13 Apr 2016 17:49:30 GMT (25kb)
[v2] Sat, 20 Aug 2016 03:19:35 GMT (30kb)
[v3] Mon, 29 May 2017 16:08:33 GMT (454kb)
[v4] Thu, 6 Sep 2018 16:53:58 GMT (36kb)
[v5] Fri, 30 Nov 2018 17:03:12 GMT (36kb)
[v6] Thu, 6 Dec 2018 22:27:52 GMT (36kb)
[v7] Thu, 8 Aug 2019 19:16:58 GMT (31kb)

Link back to: arXiv, form interface, contact.