We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.AI

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Artificial Intelligence

Title: Open Vocabulary Learning for Neural Chinese Pinyin IME

Abstract: Pinyin-to-character (P2C) conversion is the core component of pinyin-based Chinese input method engine (IME). However, the conversion is seriously compromised by the ambiguities of Chinese characters corresponding to pinyin as well as the predefined fixed vocabularies. To alleviate such inconveniences, we propose a neural P2C conversion model augmented by an online updated vocabulary with a sampling mechanism to support open vocabulary learning during IME working. Our experiments show that the proposed method outperforms commercial IMEs and state-of-the-art traditional models on standard corpus and true inputting history dataset in terms of multiple metrics and thus the online updated vocabulary indeed helps our IME effectively follows user inputting behavior.
Comments: Accepted by ACL 2019
Subjects: Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as: arXiv:1811.04352 [cs.AI]
  (or arXiv:1811.04352v4 [cs.AI] for this version)

Submission history

From: Zhuosheng Zhang [view email]
[v1] Sun, 11 Nov 2018 05:07:25 GMT (1144kb,D)
[v2] Tue, 14 May 2019 13:02:18 GMT (1421kb,D)
[v3] Wed, 5 Jun 2019 07:11:16 GMT (2843kb,D)
[v4] Thu, 6 Jun 2019 12:54:31 GMT (2843kb,D)

Link back to: arXiv, form interface, contact.