We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Model Selection's Disparate Impact in Real-World Deep Learning Applications

Abstract: Algorithmic fairness has emphasized the role of biased data in automated decision outcomes. Recently, there has been a shift in attention to sources of bias that implicate fairness in other stages in the ML pipeline. We contend that one source of such bias, human preferences in model selection, remains under-explored in terms of its role in disparate impact across demographic groups. Using a deep learning model trained on real-world medical imaging data, we verify our claim empirically and argue that choice of metric for model comparison, especially those that do not take variability into account, can significantly bias model selection outcomes.
Comments: Science and Engineering of Deep Learning Workshop, ICLR 2021
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
Cite as: arXiv:2104.00606 [cs.LG]
  (or arXiv:2104.00606v2 [cs.LG] for this version)

Submission history

From: A. Feder Cooper [view email]
[v1] Thu, 1 Apr 2021 16:37:01 GMT (121kb,D)
[v2] Tue, 7 Sep 2021 20:06:52 GMT (121kb,D)

Link back to: arXiv, form interface, contact.