We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: MDQE: A More Accurate Direct Pretraining for Machine Translation Quality Estimation

Authors: Lei Lin
Abstract: It is expensive to evaluate the results of Machine Translation(MT), which usually requires manual translation as a reference. Machine Translation Quality Estimation (QE) is a task of predicting the quality of machine translations without relying on any reference. Recently, the emergence of predictor-estimator framework which trains the predictor as a feature extractor and estimator as a QE predictor, and pre-trained language models(PLM) have achieved promising QE performance. However, we argue that there are still gaps between the predictor and the estimator in both data quality and training objectives, which preclude QE models from benefiting from a large number of parallel corpora more directly. Based on previous related work that have alleviated gaps to some extent, we propose a novel framework that provides a more accurate direct pretraining for QE tasks. In this framework, a generator is trained to produce pseudo data that is closer to the real QE data, and a estimator is pretrained on these data with novel objectives that are the same as the QE task. Experiments on widely used benchmarks show that our proposed framework outperforms existing methods, without using any pretraining models such as BERT.
Comments: arXiv admin note: substantial text overlap with arXiv:2105.07149 by other authors
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2107.14600 [cs.CL]
  (or arXiv:2107.14600v1 [cs.CL] for this version)

Submission history

From: Lei Lin [view email]
[v1] Sat, 24 Jul 2021 09:48:37 GMT (48kb,D)

Link back to: arXiv, form interface, contact.