We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Revisiting Neural Language Modelling with Syllables

Abstract: Language modelling is regularly analysed at word, subword or character units, but syllables are seldom used. Syllables provide shorter sequences than characters, they can be extracted with rules, and their segmentation typically requires less specialised effort than identifying morphemes. We reconsider syllables for an open-vocabulary generation task in 20 languages. We use rule-based syllabification methods for five languages and address the rest with a hyphenation tool, which behaviour as syllable proxy is validated. With a comparable perplexity, we show that syllables outperform characters, annotated morphemes and unsupervised subwords. Finally, we also study the overlapping of syllables concerning other subword pieces and discuss some limitations and opportunities.
Comments: 5 pages (main paper), 4 pages of Appendix
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2010.12881 [cs.CL]
  (or arXiv:2010.12881v1 [cs.CL] for this version)

Submission history

From: Arturo Oncevay [view email]
[v1] Sat, 24 Oct 2020 11:44:41 GMT (1201kb,D)

Link back to: arXiv, form interface, contact.