Current browse context:
cs.CL
Change to browse by:
References & Citations
Computer Science > Computation and Language
Title: Predictive Biases in Natural Language Processing Models: A Conceptual Framework and Overview
(Submitted on 9 Nov 2019 (v1), last revised 12 Sep 2020 (this version, v2))
Abstract: An increasing number of works in natural language processing have addressed the effect of bias on the predicted outcomes, introducing mitigation techniques that act on different parts of the standard NLP pipeline (data and models). However, these works have been conducted in isolation, without a unifying framework to organize efforts within the field. This leads to repetitive approaches, and puts an undue focus on the effects of bias, rather than on their origins. Research focused on bias symptoms rather than the underlying origins could limit the development of effective countermeasures. In this paper, we propose a unifying conceptualization: the predictive bias framework for NLP. We summarize the NLP literature and propose a general mathematical definition of predictive bias in NLP along with a conceptual framework, differentiating four main origins of biases: label bias, selection bias, model overamplification, and semantic bias. We discuss how past work has countered each bias origin. Our framework serves to guide an introductory overview of predictive bias in NLP, integrating existing work into a single structure and opening avenues for future research.
Submission history
From: Deven Santosh Shah [view email][v1] Sat, 9 Nov 2019 23:53:19 GMT (565kb,D)
[v2] Sat, 12 Sep 2020 19:56:10 GMT (1153kb,D)
Link back to: arXiv, form interface, contact.