References & Citations
Computer Science > Computation and Language
Title: Selection Collider Bias in Large Language Models
(Submitted on 22 Aug 2022 (v1), last revised 13 Sep 2022 (this version, v2))
Abstract: In this paper we motivate the causal mechanisms behind sample selection induced collider bias (selection collider bias) that can cause Large Language Models (LLMs) to learn unconditional dependence between entities that are unconditionally independent in the real world. We show that selection collider bias can become amplified in underspecified learning tasks, and although difficult to overcome, we describe a method to exploit the resulting spurious correlations for determination of when a model may be uncertain about its prediction. We demonstrate an uncertainty metric that matches human uncertainty in tasks with gender pronoun underspecification on an extended version of the Winogender Schemas evaluation set, and we provide an online demo where users can apply our uncertainty metric to their own texts and models.
Submission history
From: Emily McMilin [view email][v1] Mon, 22 Aug 2022 05:38:15 GMT (7640kb,D)
[v2] Tue, 13 Sep 2022 04:30:35 GMT (6787kb,D)
Link back to: arXiv, form interface, contact.