Title: Efficiency of minimizing compositions of convex functions and smooth maps

Abstract: We consider the problem of minimizing a sum of a convex function and a composition of a convex function with a smooth map. Important examples include exact penalty formulations of nonlinear programs and nonlinear least squares problems with side constraints. The basic algorithm we rely on is the well-known prox-linear method, which in each iteration solves a regularized subproblem formed by linearizing the smooth map. When the subproblems are solved exactly, the method has the efficiency guarantee $O(\varepsilon^{-2})$, akin to gradient descent for smooth minimization. We show that when the subproblems can only be solved by first-order methods, a simple combination of the prox-linear method, smoothing, and fast-gradient subsolves yields a scheme with overall efficiency $O(\varepsilon^{-3})$. We finish the paper with extensions to large-finite sum problems and an inertial prox-linear method that automatically accelerates in presence of convexity.