We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Block Alternating Bregman Majorization Minimization with Extrapolation

Abstract: In this paper, we consider a class of nonsmooth nonconvex optimization problems whose objective is the sum of a block relative smooth function and a proper and lower semicontinuous block separable function. Although the analysis of block proximal gradient (BPG) methods for the class of block $L$-smooth functions have been successfully extended to Bregman BPG methods that deal with the class of block relative smooth functions, accelerated Bregman BPG methods are scarce and challenging to design. Taking our inspiration from Nesterov-type acceleration and the majorization-minimization scheme, we propose a block alternating Bregman Majorization-Minimization framework with Extrapolation (BMME). We prove subsequential convergence of BMME to a first-order stationary point under mild assumptions, and study its global convergence under stronger conditions. We illustrate the effectiveness of BMME on the penalized orthogonal nonnegative matrix factorization problem.
Subjects: Optimization and Control (math.OC); Signal Processing (eess.SP); Numerical Analysis (math.NA); Machine Learning (stat.ML)
Cite as: arXiv:2107.04395 [math.OC]
  (or arXiv:2107.04395v1 [math.OC] for this version)

Submission history

From: Nicolas Gillis [view email]
[v1] Fri, 9 Jul 2021 12:47:00 GMT (15264kb,D)

Link back to: arXiv, form interface, contact.