We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.HC

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Human-Computer Interaction

Title: Explainability's Gain is Optimality's Loss? -- How Explanations Bias Decision-making

Abstract: Decisions in organizations are about evaluating alternatives and choosing the one that would best serve organizational goals. To the extent that the evaluation of alternatives could be formulated as a predictive task with appropriate metrics, machine learning algorithms are increasingly being used to improve the efficiency of the process. Explanations help to facilitate communication between the algorithm and the human decision-maker, making it easier for the latter to interpret and make decisions on the basis of predictions by the former. Feature-based explanations' semantics of causal models, however, induce leakage from the decision-maker's prior beliefs. Our findings from a field experiment demonstrate empirically how this leads to confirmation bias and disparate impact on the decision-maker's confidence in the predictions. Such differences can lead to sub-optimal and biased decision outcomes.
Comments: To appear in the Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society (AIES '22)
Subjects: Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
DOI: 10.1145/3514094.3534156
Cite as: arXiv:2206.08705 [cs.HC]
  (or arXiv:2206.08705v2 [cs.HC] for this version)

Submission history

From: Charles Wan [view email]
[v1] Fri, 17 Jun 2022 11:43:42 GMT (601kb,D)
[v2] Wed, 29 Jun 2022 14:48:16 GMT (601kb,D)

Link back to: arXiv, form interface, contact.