We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: The NiuTrans System for the WMT21 Efficiency Task

Abstract: This paper describes the NiuTrans system for the WMT21 translation efficiency task (this http URL). Following last year's work, we explore various techniques to improve efficiency while maintaining translation quality. We investigate the combinations of lightweight Transformer architectures and knowledge distillation strategies. Also, we improve the translation efficiency with graph optimization, low precision, dynamic batching, and parallel pre/post-processing. Our system can translate 247,000 words per second on an NVIDIA A100, being 3$\times$ faster than last year's system. Our system is the fastest and has the lowest memory consumption on the GPU-throughput track. The code, model, and pipeline will be available at NiuTrans.NMT (this https URL).
Comments: NiuTrans at the WMT21 Translation Efficiency Task
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2109.08003 [cs.CL]
  (or arXiv:2109.08003v1 [cs.CL] for this version)

Submission history

From: Hu Chi [view email]
[v1] Thu, 16 Sep 2021 14:21:52 GMT (64kb,D)

Link back to: arXiv, form interface, contact.