We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: A Review of Bangla Natural Language Processing Tasks and the Utility of Transformer Models

Abstract: Bangla -- ranked as the 6th most widely spoken language across the world (this https URL), with 230 million native speakers -- is still considered as a low-resource language in the natural language processing (NLP) community. With three decades of research, Bangla NLP (BNLP) is still lagging behind mainly due to the scarcity of resources and the challenges that come with it. There is sparse work in different areas of BNLP; however, a thorough survey reporting previous work and recent advances is yet to be done. In this study, we first provide a review of Bangla NLP tasks, resources, and tools available to the research community; we benchmark datasets collected from various platforms for nine NLP tasks using current state-of-the-art algorithms (i.e., transformer-based models). We provide comparative results for the studied NLP tasks by comparing monolingual vs. multilingual models of varying sizes. We report our results using both individual and consolidated datasets and provide data splits for future research. We reviewed a total of 108 papers and conducted 175 sets of experiments. Our results show promising performance using transformer-based models while highlighting the trade-off with computational costs. We hope that such a comprehensive survey will motivate the community to build on and further advance the research on Bangla NLP.
Comments: Under Review, Bangla language processing, text classification, sequence tagging, datasets, benchmarks, transformer models
Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)
MSC classes: 68T50
ACM classes: I.2.7
Cite as: arXiv:2107.03844 [cs.CL]
  (or arXiv:2107.03844v3 [cs.CL] for this version)

Submission history

From: Firoj Alam [view email]
[v1] Thu, 8 Jul 2021 13:49:46 GMT (7580kb,D)
[v2] Sun, 11 Jul 2021 06:43:33 GMT (7580kb,D)
[v3] Sun, 25 Jul 2021 05:41:15 GMT (7581kb,D)

Link back to: arXiv, form interface, contact.