Current browse context:
cs
Change to browse by:
References & Citations
Condensed Matter > Statistical Mechanics
Title: Thermodynamics-inspired Explanations of Artificial Intelligence
(Submitted on 27 Jun 2022 (v1), last revised 8 Apr 2024 (this version, v3))
Abstract: In recent years, predictive machine learning methods have gained prominence in various scientific domains. However, due to their black-box nature, it is essential to establish trust in these models before accepting them as accurate. One promising strategy for assigning trust involves employing explanation techniques that elucidate the rationale behind a black-box model's predictions in a manner that humans can understand. However, assessing the degree of human interpretability of the rationale generated by such methods is a nontrivial challenge. In this work, we introduce interpretation entropy as a universal solution for assessing the degree of human interpretability associated with any linear model. Using this concept and drawing inspiration from classical thermodynamics, we present Thermodynamics-inspired Explainable Representations of AI and other black-box Paradigms (TERP), a method for generating accurate, and human-interpretable explanations for black-box predictions in a model-agnostic manner. To demonstrate the wide-ranging applicability of TERP, we successfully employ it to explain various black-box model architectures, including deep learning Autoencoders, Recurrent Neural Networks, and Convolutional Neural Networks, across diverse domains such as molecular simulations, text, and image classification.
Submission history
From: Pratyush Tiwary [view email][v1] Mon, 27 Jun 2022 17:36:50 GMT (35676kb,AD)
[v2] Fri, 3 Mar 2023 15:11:15 GMT (40563kb,AD)
[v3] Mon, 8 Apr 2024 23:41:21 GMT (36503kb,D)
Link back to: arXiv, form interface, contact.