Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Learning Credible Models
(Submitted on 8 Nov 2017 (v1), last revised 7 Jun 2018 (this version, v3))
Abstract: In many settings, it is important that a model be capable of providing reasons for its predictions (i.e., the model must be interpretable). However, the model's reasoning may not conform with well-established knowledge. In such cases, while interpretable, the model lacks \textit{credibility}. In this work, we formally define credibility in the linear setting and focus on techniques for learning models that are both accurate and credible. In particular, we propose a regularization penalty, expert yielded estimates (EYE), that incorporates expert knowledge about well-known relationships among covariates and the outcome of interest. We give both theoretical and empirical results comparing our proposed method to several other regularization techniques. Across a range of settings, experiments on both synthetic and real data show that models learned using the EYE penalty are significantly more credible than those learned using other penalties. Applied to a large-scale patient risk stratification task, our proposed technique results in a model whose top features overlap significantly with known clinical risk factors, while still achieving good predictive performance.
Submission history
From: Jiaxuan Wang [view email][v1] Wed, 8 Nov 2017 22:28:09 GMT (702kb,D)
[v2] Tue, 14 Nov 2017 23:52:27 GMT (703kb,D)
[v3] Thu, 7 Jun 2018 18:46:56 GMT (728kb,D)
Link back to: arXiv, form interface, contact.