We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Inequality Constrained Stochastic Nonlinear Optimization via Active-Set Sequential Quadratic Programming

Abstract: We study nonlinear optimization problems with a stochastic objective and deterministic equality and inequality constraints, which emerge in numerous applications including finance, manufacturing, power systems and, recently, deep neural networks. We propose an active-set stochastic sequential quadratic programming algorithm that uses a differentiable exact augmented Lagrangian as the merit function. The algorithm adaptively selects the penalty parameters of the augmented Lagrangian, and performs stochastic line search to decide the stepsize. The global convergence is established: for any initialization, the "liminf" of the KKT residuals converges to zero almost surely. Our algorithm and analysis further develop the work of Na et al. (2021) by allowing nonlinear inequality constraints without requiring the strict complementary condition. We demonstrate the performance of the algorithm on a subset of nonlinear problems collected in CUTEst test set.
Comments: 61 pages, 5 figures
Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Numerical Analysis (math.NA); Machine Learning (stat.ML)
Cite as: arXiv:2109.11502 [math.OC]
  (or arXiv:2109.11502v2 [math.OC] for this version)

Submission history

From: Sen Na [view email]
[v1] Thu, 23 Sep 2021 17:12:17 GMT (287kb,D)
[v2] Tue, 22 Feb 2022 09:57:17 GMT (952kb,D)

Link back to: arXiv, form interface, contact.