References & Citations
Mathematics > Optimization and Control
Title: Inexact Model: A Framework for Optimization and Variational Inequalities
(Submitted on 3 Feb 2019 (v1), last revised 5 Jan 2020 (this version, v6))
Abstract: In this paper we propose a general algorithmic framework for first-order methods in optimization in a broad sense, including minimization problems, saddle-point problems and variational inequalities. This framework allows to obtain many known methods as a special case, the list including accelerated gradient method, composite optimization methods, level-set methods, proximal methods. The idea of the framework is based on constructing an inexact model of the main problem component, i.e. objective function in optimization or operator in variational inequalities. Besides reproducing known results, our framework allows to construct new methods, which we illustrate by constructing a universal method for variational inequalities with composite structure. This method works for smooth and non-smooth problems with optimal complexity without a priori knowledge of the problem smoothness. We also generalize our framework for strongly convex objectives and strongly monotone variational inequalities.
Submission history
From: Alexander Gasnikov [view email][v1] Sun, 3 Feb 2019 23:35:22 GMT (1042kb)
[v2] Wed, 27 Feb 2019 19:43:05 GMT (673kb)
[v3] Wed, 6 Mar 2019 18:40:48 GMT (103kb)
[v4] Mon, 18 Mar 2019 07:18:01 GMT (483kb)
[v5] Tue, 10 Sep 2019 09:31:30 GMT (80kb)
[v6] Sun, 5 Jan 2020 22:05:04 GMT (80kb)
Link back to: arXiv, form interface, contact.