We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computation and Language

Title: Neural Arabic Text Diacritization: State of the Art Results and a Novel Approach for Machine Translation

Abstract: In this work, we present several deep learning models for the automatic diacritization of Arabic text. Our models are built using two main approaches, viz. Feed-Forward Neural Network (FFNN) and Recurrent Neural Network (RNN), with several enhancements such as 100-hot encoding, embeddings, Conditional Random Field (CRF) and Block-Normalized Gradient (BNG). The models are tested on the only freely available benchmark dataset and the results show that our models are either better or on par with other models, which require language-dependent post-processing steps, unlike ours. Moreover, we show that diacritics in Arabic can be used to enhance the models of NLP tasks such as Machine Translation (MT) by proposing the Translation over Diacritization (ToD) approach.
Comments: 18 pages, 17 figures, 14 tables
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)
DOI: 10.18653/v1/D19-5229
Cite as: arXiv:1911.03531 [cs.CL]
  (or arXiv:1911.03531v1 [cs.CL] for this version)

Submission history

From: Ali Fadel [view email]
[v1] Fri, 8 Nov 2019 20:52:12 GMT (2635kb,D)

Link back to: arXiv, form interface, contact.