We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations

DBLP - CS Bibliography


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Text Style Transfer for Bias Mitigation using Masked Language Modeling

Abstract: It is well known that textual data on the internet and other digital platforms contain significant levels of bias and stereotypes. Although many such texts contain stereotypes and biases that inherently exist in natural language for reasons that are not necessarily malicious, there are crucial reasons to mitigate these biases. For one, these texts are being used as training corpus to train language models for salient applications like cv-screening, search engines, and chatbots; such applications are turning out to produce discriminatory results. Also, several research findings have concluded that biased texts have significant effects on the target demographic groups. For instance, masculine-worded job advertisements tend to be less appealing to female applicants.
In this paper, we present a text style transfer model that can be used to automatically debias textual data. Our style transfer model improves on the limitations of many existing style transfer techniques such as loss of content information. Our model solves such issues by combining latent content encoding with explicit keyword replacement. We will show that this technique produces better content preservation whilst maintaining good style transfer accuracy.
Comments: 9 pages, 3 figures, 5 tables
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2201.08643 [cs.CL]
  (or arXiv:2201.08643v1 [cs.CL] for this version)

Submission history

From: Ewoenam Kwaku Tokpo [view email]
[v1] Fri, 21 Jan 2022 11:06:33 GMT (8213kb,D)

Link back to: arXiv, form interface, contact.