We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Improving Formality Style Transfer with Context-Aware Rule Injection

Abstract: Models pre-trained on large-scale regular text corpora often do not work well for user-generated data where the language styles differ significantly from the mainstream text. Here we present Context-Aware Rule Injection (CARI), an innovative method for formality style transfer (FST). CARI injects multiple rules into an end-to-end BERT-based encoder and decoder model. It learns to select optimal rules based on context. The intrinsic evaluation showed that CARI achieved the new highest performance on the FST benchmark dataset. Our extrinsic evaluation showed that CARI can greatly improve the regular pre-trained models' performance on several tweet sentiment analysis tasks.
Comments: ACL2021
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2106.00210 [cs.CL]
  (or arXiv:2106.00210v1 [cs.CL] for this version)

Submission history

From: Zonghai Yao [view email]
[v1] Tue, 1 Jun 2021 03:59:07 GMT (5334kb,D)

Link back to: arXiv, form interface, contact.