We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: On solving convex min-min problems with smoothness and strong convexity in one variable group and small dimension of the other

Abstract: This paper is devoted to some approaches for convex min-min problems with smoothness and strong convexity in only one of the two variable groups. It is shown that the proposed approaches, based on Vaidya's cutting plane method and Nesterov's fast gradient method, achieve the linear convergence. The outer minimization problem is solved using Vaidya's cutting plane method, and the inner problem (smooth and strongly convex) is solved using the fast gradient method. Due to the importance of machine learning applications, we also consider the case when the objective function is a sum of a large number of functions. In this case, the variance-reduced accelerated gradient algorithm is used instead of Nesterov's fast gradient method. The numerical experiments' results illustrate the advantages of the proposed procedures for logistic regression with the prior on one of the parameter groups.
Comments: 15 pages, 2 figures, in Russian
Subjects: Optimization and Control (math.OC)
Cite as: arXiv:2102.00584 [math.OC]
  (or arXiv:2102.00584v1 [math.OC] for this version)

Submission history

From: Egor Gladin [view email]
[v1] Mon, 1 Feb 2021 01:38:56 GMT (105kb,D)

Link back to: arXiv, form interface, contact.