References & Citations
Computer Science > Computation and Language
Title: Approaching Neural Chinese Word Segmentation as a Low-Resource Machine Translation Task
(Submitted on 12 Aug 2020 (v1), last revised 11 Oct 2022 (this version, v3))
Abstract: Chinese word segmentation has entered the deep learning era which greatly reduces the hassle of feature engineering. Recently, some researchers attempted to treat it as character-level translation, which further simplified model designing, but there is a performance gap between the translation-based approach and other methods. This motivates our work, in which we apply the best practices from low-resource neural machine translation to supervised Chinese segmentation. We examine a series of techniques including regularization, data augmentation, objective weighting, transfer learning, and ensembling. Compared to previous works, our low-resource translation-based method maintains the effortless model design, yet achieves the same result as state of the art in the constrained evaluation without using additional data.
Submission history
From: Pinzhen Chen [view email][v1] Wed, 12 Aug 2020 14:40:51 GMT (39kb)
[v2] Tue, 12 Jan 2021 16:08:56 GMT (39kb,D)
[v3] Tue, 11 Oct 2022 10:01:33 GMT (37kb,D)
Link back to: arXiv, form interface, contact.