We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Measuring and Increasing Context Usage in Context-Aware Machine Translation

Abstract: Recent work in neural machine translation has demonstrated both the necessity and feasibility of using inter-sentential context -- context from sentences other than those currently being translated. However, while many current methods present model architectures that theoretically can use this extra context, it is often not clear how much they do actually utilize it at translation time. In this paper, we introduce a new metric, conditional cross-mutual information, to quantify the usage of context by these models. Using this metric, we measure how much document-level machine translation systems use particular varieties of context. We find that target context is referenced more than source context, and that conditioning on a longer context has a diminishing effect on results. We then introduce a new, simple training method, context-aware word dropout, to increase the usage of context by context-aware models. Experiments show that our method increases context usage and that this reflects on the translation quality according to metrics such as BLEU and COMET, as well as performance on anaphoric pronoun resolution and lexical cohesion contrastive datasets.
Comments: ACL 2021
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2105.03482 [cs.CL]
  (or arXiv:2105.03482v2 [cs.CL] for this version)

Submission history

From: Patrick Fernandes [view email]
[v1] Fri, 7 May 2021 19:55:35 GMT (5292kb,D)
[v2] Wed, 2 Jun 2021 11:07:39 GMT (5293kb,D)

Link back to: arXiv, form interface, contact.