We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Solving Stochastic Optimization with Expectation Constraints Efficiently by a Stochastic Augmented Lagrangian-Type Algorithm

Abstract: This paper considers the problem of minimizing a convex expectation function with a set of inequality convex expectation constraints. We present a computable stochastic approximation type algorithm, namely the stochastic linearized proximal method of multipliers, to solve this convex stochastic optimization problem. This algorithm can be roughly viewed as a hybrid of stochastic approximation and the traditional proximal method of multipliers. Under mild conditions, we show that this algorithm exhibits $O(K^{-1/2})$ expected convergence rates for both objective reduction and constraint violation if parameters in the algorithm are properly chosen, where $K$ denotes the number of iterations. Moreover, we show that, with high probability, the algorithm has $O(\log(K)K^{-1/2})$ constraint violation bound and $O(\log^{3/2}(K)K^{-1/2})$ objective bound. Some preliminary numerical results demonstrate the performance of the proposed algorithm.
Subjects: Optimization and Control (math.OC); Machine Learning (stat.ML)
MSC classes: 62L20, 90C15, 49M37
Cite as: arXiv:2106.11577 [math.OC]
  (or arXiv:2106.11577v3 [math.OC] for this version)

Submission history

From: Xiantao Xiao [view email]
[v1] Tue, 22 Jun 2021 07:24:17 GMT (1082kb,D)
[v2] Sat, 19 Mar 2022 03:14:09 GMT (1169kb)
[v3] Wed, 15 Jun 2022 02:26:00 GMT (1412kb)

Link back to: arXiv, form interface, contact.