References & Citations
Computer Science > Computation and Language
Title: Online Versus Offline NMT Quality: An In-depth Analysis on English-German and German-English
(Submitted on 1 Jun 2020 (v1), last revised 24 Nov 2020 (this version, v3))
Abstract: We conduct in this work an evaluation study comparing offline and online neural machine translation architectures. Two sequence-to-sequence models: convolutional Pervasive Attention (Elbayad et al. 2018) and attention-based Transformer (Vaswani et al. 2017) are considered. We investigate, for both architectures, the impact of online decoding constraints on the translation quality through a carefully designed human evaluation on English-German and German-English language pairs, the latter being particularly sensitive to latency constraints. The evaluation results allow us to identify the strengths and shortcomings of each model when we shift to the online setup.
Submission history
From: Maha Elbayad [view email][v1] Mon, 1 Jun 2020 09:43:54 GMT (1883kb,D)
[v2] Sat, 24 Oct 2020 13:36:00 GMT (1926kb,D)
[v3] Tue, 24 Nov 2020 09:10:30 GMT (1926kb,D)
Link back to: arXiv, form interface, contact.