We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Gender Bias Amplification During Speed-Quality Optimization in Neural Machine Translation

Abstract: Is bias amplified when neural machine translation (NMT) models are optimized for speed and evaluated on generic test sets using BLEU? We investigate architectures and techniques commonly used to speed up decoding in Transformer-based models, such as greedy search, quantization, average attention networks (AANs) and shallow decoder models and show their effect on gendered noun translation. We construct a new gender bias test set, SimpleGEN, based on gendered noun phrases in which there is a single, unambiguous, correct answer. While we find minimal overall BLEU degradation as we apply speed optimizations, we observe that gendered noun translation performance degrades at a much faster rate.
Comments: Accepted at ACL 2021
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2106.00169 [cs.CL]
  (or arXiv:2106.00169v1 [cs.CL] for this version)

Submission history

From: Adithya Renduchintala [view email]
[v1] Tue, 1 Jun 2021 01:32:08 GMT (5396kb,D)

Link back to: arXiv, form interface, contact.