We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Multilingual Unsupervised Neural Machine Translation with Denoising Adapters

Abstract: We consider the problem of multilingual unsupervised machine translation, translating to and from languages that only have monolingual data by using auxiliary parallel language pairs. For this problem the standard procedure so far to leverage the monolingual data is back-translation, which is computationally costly and hard to tune.
In this paper we propose instead to use denoising adapters, adapter layers with a denoising objective, on top of pre-trained mBART-50. In addition to the modularity and flexibility of such an approach we show that the resulting translations are on-par with back-translating as measured by BLEU, and furthermore it allows adding unseen languages incrementally.
Comments: Accepted as a long paper to EMNLP 2021
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2110.10472 [cs.CL]
  (or arXiv:2110.10472v1 [cs.CL] for this version)

Submission history

From: Ahmet Üstün [view email]
[v1] Wed, 20 Oct 2021 10:18:29 GMT (415kb,D)

Link back to: arXiv, form interface, contact.