We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: It's Morphin' Time! Combating Linguistic Discrimination with Inflectional Perturbations

Abstract: Training on only perfect Standard English corpora predisposes pre-trained neural networks to discriminate against minorities from non-standard linguistic backgrounds (e.g., African American Vernacular English, Colloquial Singapore English, etc.). We perturb the inflectional morphology of words to craft plausible and semantically similar adversarial examples that expose these biases in popular NLP models, e.g., BERT and Transformer, and show that adversarially fine-tuning them for a single epoch significantly improves robustness without sacrificing performance on clean data.
Comments: To appear in the Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020)
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)
DOI: 10.18653/v1/2020.acl-main.263
Cite as: arXiv:2005.04364 [cs.CL]
  (or arXiv:2005.04364v1 [cs.CL] for this version)

Submission history

From: Samson Tan [view email]
[v1] Sat, 9 May 2020 04:01:43 GMT (513kb,D)

Link back to: arXiv, form interface, contact.