We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Level Constrained First Order Methods for Function Constrained Optimization

Abstract: We present a new feasible proximal gradient method for constrained optimization where both the objective and constraint functions are given by summation of a smooth, possibly nonconvex function and a convex simple function. The algorithm converts the original problem into a sequence of convex subproblems. Either exact or approximate solutions of convex subproblems can be computed efficiently in many cases. For the inexact case, computing the solution of the subproblem requires evaluation of at most one gradient/function-value of the original objective and constraint functions. An important feature of the algorithm is the constraint level parameter. By carefully increasing this level for each subproblem, we provide a simple solution to overcome the challenge of bounding the Lagrangian multipliers, and show that the algorithm follows a strictly feasible solution path till convergence to the stationary point. Finally, we develop a simple, proximal gradient descent type analysis, showing that the complexity bound of this new algorithm is comparable to gradient descent for the unconstrained setting which is new in the literature. Exploiting this new design and analysis technique, we extend our algorithms to some more challenging constrained optimization problems where 1) the objective is a stochastic or finite-sum function, and 2) structured nonsmooth functions replace smooth components of both objective and constraint functions. Complexity results for these problems also seem to be new in the literature. We also show that our method can be applied for convex function constrained problems where we show complexities similar to the proximal gradient method.
Subjects: Optimization and Control (math.OC)
MSC classes: 90C26, 90C30, 90C06, 90C51, 49M37
Cite as: arXiv:2205.08011 [math.OC]
  (or arXiv:2205.08011v1 [math.OC] for this version)

Submission history

From: Digvijay Boob [view email]
[v1] Mon, 16 May 2022 22:46:43 GMT (68kb)

Link back to: arXiv, form interface, contact.