We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Selecting Parallel In-domain Sentences for Neural Machine Translation Using Monolingual Texts

Abstract: Continuously-growing data volumes lead to larger generic models. Specific use-cases are usually left out, since generic models tend to perform poorly in domain-specific cases. Our work addresses this gap with a method for selecting in-domain data from generic-domain (parallel text) corpora, for the task of machine translation. The proposed method ranks sentences in parallel general-domain data according to their cosine similarity with a monolingual domain-specific data set. We then select the top K sentences with the highest similarity score to train a new machine translation system tuned to the specific in-domain data. Our experimental results show that models trained on this in-domain data outperform models trained on generic or a mixture of generic and domain data. That is, our method selects high-quality domain-specific training instances at low computational cost and data size.
Comments: Accepted to the CLIN Journal on Dec 6, 2021 (Camera-ready Version)
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as: arXiv:2112.06096 [cs.CL]
  (or arXiv:2112.06096v3 [cs.CL] for this version)

Submission history

From: Javad Pourmostafa Roshan Sharami [view email]
[v1] Sat, 11 Dec 2021 23:29:26 GMT (1159kb,D)
[v2] Mon, 20 Dec 2021 23:27:15 GMT (1330kb,D)
[v3] Sun, 6 Feb 2022 20:23:59 GMT (1332kb,D)

Link back to: arXiv, form interface, contact.