We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Optimization and Control

Title: Composite Convex Optimization with Global and Local Inexact Oracles

Abstract: We introduce new global and local inexact oracle concepts for a wide class of convex functions in composite convex minimization. Such inexact oracles naturally come from primal-dual framework, barrier smoothing, inexact computations of gradients and Hessian, and many other situations. We also provide examples showing that the class of convex functions equipped with the newly inexact second-order oracles is larger than standard self-concordant as well as Lipschitz gradient function classes. Further, we investigate several properties of convex and/or self-concordant functions under the inexact second-order oracles which are useful for algorithm development. Next, we apply our theory to develop inexact proximal Newton-type schemes for minimizing general composite convex minimization problems equipped with such inexact oracles. Our theoretical results consist of new optimization algorithms, accompanied with global convergence guarantees to solve a wide class of composite convex optimization problems. When the first objective term is additionally self-concordant, we establish different local convergence results for our method. In particular, we prove that depending on the choice of accuracy levels of the inexact second-order oracles, we obtain different local convergence rates ranging from $R$-linear and $R$-superlinear to $R$-quadratic. In special cases, where convergence bounds are known, our theory recovers the best known rates. We also apply our settings to derive a new primal-dual method for composite convex minimization problems. Finally, we present some representative numerical examples to illustrate the benefit of our new algorithms.
Comments: 28 pages, 6 figures, and 2 tables
Subjects: Optimization and Control (math.OC)
MSC classes: 90C25, 90C06, 90-08
Journal reference: Computational Optimization and Applications, 2020
DOI: 10.1007/s10589-020-00174-2
Report number: UNC-STOR Tech. Report No. III (07.2018)
Cite as: arXiv:1808.02121 [math.OC]
  (or arXiv:1808.02121v2 [math.OC] for this version)

Submission history

From: Quoc Tran-Dinh [view email]
[v1] Mon, 6 Aug 2018 21:20:43 GMT (523kb,D)
[v2] Sun, 23 Feb 2020 03:26:35 GMT (472kb,D)

Link back to: arXiv, form interface, contact.