References & Citations
Computer Science > Machine Learning
Title: Training Experimentally Robust and Interpretable Binarized Regression Models Using Mixed-Integer Programming
(Submitted on 1 Dec 2021 (v1), last revised 19 Mar 2022 (this version, v2))
Abstract: In this paper, we explore model-based approach to training robust and interpretable binarized regression models for multiclass classification tasks using Mixed-Integer Programming (MIP). Our MIP model balances the optimization of prediction margin and model size by using a weighted objective that: minimizes the total margin of incorrectly classified training instances, maximizes the total margin of correctly classified training instances, and maximizes the overall model regularization. We conduct two sets of experiments to test the classification accuracy of our MIP model over standard and corrupted versions of multiple classification datasets, respectively. In the first set of experiments, we show that our MIP model outperforms an equivalent Pseudo-Boolean Optimization (PBO) model and achieves competitive results to Logistic Regression (LR) and Gradient Descent (GD) in terms of classification accuracy over the standard datasets. In the second set of experiments, we show that our MIP model outperforms the other models (i.e., GD and LR) in terms of classification accuracy over majority of the corrupted datasets. Finally, we visually demonstrate the interpretability of our MIP model in terms of its learned parameters over the MNIST dataset. Overall, we show the effectiveness of training robust and interpretable binarized regression models using MIP.
Submission history
From: Buser Say [view email][v1] Wed, 1 Dec 2021 11:53:08 GMT (2989kb,D)
[v2] Sat, 19 Mar 2022 08:59:37 GMT (3324kb,D)
Link back to: arXiv, form interface, contact.