We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.NA

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Numerical Analysis

Title: A New Multipoint Symmetric Secant Method with a Dense Initial Matrix

Abstract: In large-scale optimization, when either forming or storing Hessian matrices are prohibitively expensive, quasi-Newton methods are often used in lieu of Newton's method because they only require first-order information to approximate the true Hessian. Multipoint symmetric secant (MSS) methods can be thought of as generalizations of quasi-Newton methods in that they attempt to impose additional requirements on their approximation of the Hessian. Given an initial Hessian approximation, MSS methods generate a sequence of possibly-indefinite matrices using rank-2 updates to solve nonconvex unconstrained optimization problems. For practical reasons, up to now, the initialization has been a constant multiple of the identity matrix. In this paper, we propose a new limited-memory MSS method for large-scale nonconvex optimization that allows for dense initializations. Numerical results on the CUTEst test problems suggest that the MSS method using a dense initialization outperforms the standard initialization. Numerical results also suggest that this approach is competitive with both a basic L-SR1 trust-region method and an L-PSB method.
Subjects: Numerical Analysis (math.NA); Optimization and Control (math.OC)
Cite as: arXiv:2107.06321 [math.NA]
  (or arXiv:2107.06321v3 [math.NA] for this version)

Submission history

From: Jennifer Erway [view email]
[v1] Tue, 13 Jul 2021 18:30:39 GMT (76kb,D)
[v2] Mon, 26 Jul 2021 17:12:34 GMT (57kb,D)
[v3] Tue, 9 Aug 2022 23:12:26 GMT (58kb,D)

Link back to: arXiv, form interface, contact.