We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: Learning Optimized Risk Scores on Large-Scale Datasets

Abstract: Risk scores are simple classification models that let users quickly assess risk by adding, subtracting and multiplying a few small numbers. These models are used for high-stakes applications in healthcare and criminology, but are difficult to learn from data because they need to be risk-calibrated, use small integer coefficients, and obey operational constraints. In this paper, we present a new approach to learn optimized risk scores from data by solving a discrete optimization problem. We formulate the risk score problem as a mixed integer nonlinear program, and present a new cutting plane algorithm to efficiently recover the optimal solution while avoiding the stalling behavior that occurs when we use existing cutting plane algorithms on non-convex problems. We pair our cutting plane algorithm with specialized procedures to generate feasible solutions, narrow the optimality gap, and reduce data-related computation. The resulting approach can learn optimized risk scores in a way that scales linearly in the number of samples, provides a proof of optimality, and accommodates complex operational constraints. We illustrate the benefits of our approach through extensive numerical experiments.
Subjects: Machine Learning (stat.ML); Optimization and Control (math.OC); Methodology (stat.ME)
Cite as: arXiv:1610.00168 [stat.ML]
  (or arXiv:1610.00168v1 [stat.ML] for this version)

Submission history

From: Berk Ustun [view email]
[v1] Sat, 1 Oct 2016 18:40:08 GMT (1219kb,D)
[v2] Tue, 1 Nov 2016 15:06:56 GMT (1242kb,D)
[v3] Tue, 7 Feb 2017 02:27:05 GMT (1251kb,D)
[v4] Fri, 7 Sep 2018 17:18:35 GMT (1497kb,D)
[v5] Tue, 17 Sep 2019 01:58:54 GMT (1113kb,D)

Link back to: arXiv, form interface, contact.