Current browse context:
cs.CL
Change to browse by:
References & Citations
Computer Science > Computation and Language
Title: Towards Debiasing NLU Models from Unknown Biases
(Submitted on 25 Sep 2020 (v1), last revised 13 Oct 2020 (this version, v4))
Abstract: NLU models often exploit biases to achieve high dataset-specific performance without properly learning the intended task. Recently proposed debiasing methods are shown to be effective in mitigating this tendency. However, these methods rely on a major assumption that the types of bias should be known a-priori, which limits their application to many NLU tasks and datasets. In this work, we present the first step to bridge this gap by introducing a self-debiasing framework that prevents models from mainly utilizing biases without knowing them in advance. The proposed framework is general and complementary to the existing debiasing methods. We show that it allows these existing methods to retain the improvement on the challenge datasets (i.e., sets of examples designed to expose models' reliance on biases) without specifically targeting certain biases. Furthermore, the evaluation suggests that applying the framework results in improved overall robustness.
Submission history
From: Prasetya Ajie Utama [view email][v1] Fri, 25 Sep 2020 15:49:39 GMT (986kb)
[v2] Thu, 8 Oct 2020 11:00:39 GMT (1148kb,D)
[v3] Mon, 12 Oct 2020 11:52:22 GMT (275kb,D)
[v4] Tue, 13 Oct 2020 12:37:27 GMT (336kb,D)
Link back to: arXiv, form interface, contact.