Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Incorporating Interpretable Output Constraints in Bayesian Neural Networks
(Submitted on 21 Oct 2020 (v1), last revised 6 Jan 2021 (this version, v2))
Abstract: Domains where supervised models are deployed often come with task-specific constraints, such as prior expert knowledge on the ground-truth function, or desiderata like safety and fairness. We introduce a novel probabilistic framework for reasoning with such constraints and formulate a prior that enables us to effectively incorporate them into Bayesian neural networks (BNNs), including a variant that can be amortized over tasks. The resulting Output-Constrained BNN (OC-BNN) is fully consistent with the Bayesian framework for uncertainty quantification and is amenable to black-box inference. Unlike typical BNN inference in uninterpretable parameter space, OC-BNNs widen the range of functional knowledge that can be incorporated, especially for model users without expertise in machine learning. We demonstrate the efficacy of OC-BNNs on real-world datasets, spanning multiple domains such as healthcare, criminal justice, and credit scoring.
Submission history
From: Wanqian Yang [view email][v1] Wed, 21 Oct 2020 13:00:05 GMT (4733kb,D)
[v2] Wed, 6 Jan 2021 10:07:56 GMT (4733kb,D)
Link back to: arXiv, form interface, contact.