We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Optimization and Control

Title: Minimization of Akaike's Information Criterion in Linear Regression Analysis via Mixed Integer Nonlinear Program

Abstract: Akaike's information criterion (AIC) is a measure of the quality of a statistical model for a given set of data. We can determine the best statistical model for a particular data set by the minimization of the AIC. Since we need to evaluate exponentially many candidates of the model by the minimization of the AIC, the minimization is unreasonable. Instead, stepwise methods, which are local search algorithms, are commonly used to find a better statistical model though it may not be the best.
We propose a branch and bound search algorithm for a mixed integer nonlinear programming formulation of the AIC minimization by Miyashiro and Takano (2015). More concretely, we propose methods to find lower and upper bounds, and branching rules for this minimization. We then combine them with SCIP, which is a mathematical optimization software and a branch-and-bound framework. We show that the proposed method can provide the best statistical model based on AIC for small-sized or medium-sized benchmark data sets in UCI Machine Learning Repository. Furthermore, we show that this method finds good quality solutions for large-sized benchmark data sets.
Comments: We modified abstract, introduction and the beginning of section 3 from the first version
Subjects: Optimization and Control (math.OC); Computation (stat.CO)
Journal reference: Optimization Methods and Software 33 (3), 633-649, 2018
DOI: 10.1080/10556788.2017.1333611
Cite as: arXiv:1606.05030 [math.OC]
  (or arXiv:1606.05030v2 [math.OC] for this version)

Submission history

From: Hayato Waki [view email]
[v1] Thu, 16 Jun 2016 02:55:11 GMT (18kb)
[v2] Fri, 24 Jun 2016 10:39:24 GMT (18kb)

Link back to: arXiv, form interface, contact.