We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Computation and Language

Title: Robust and Consistent Estimation of Word Embedding for Bangla Language by fine-tuning Word2Vec Model

Authors: Rifat Rahman
Abstract: Word embedding or vector representation of word holds syntactical and semantic characteristics of word which can be an informative feature for any machine learning based models of natural language processing. There are several deep learning based models for the vectorization of words like word2vec, fasttext, gensim, glove etc. In this study, we analysis word2vec model for learning word vectors by tuning different hyper-parameters and present the most effective word embedding for Bangla language. For testing the performances of different word embeddings induced by fine-tuning of word2vec model, we perform both intrinsic and extrinsic evaluations. We cluster the word vectors to examine the relational similarity of words and also use different word embeddings as the feature of news article classifier for extrinsic evaluation. From our experiment, we discover that the word vectors with 300 dimension, generated from 'skip-gram' method of word2vec model using the sliding window size of 4, are giving the most robust vector representations for Bangla language.
Comments: 6 pages, 8 figures, submitted to 23rd International Conference of Computer and Information Technology (ICCIT). IEEE, 2020
Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)
Cite as: arXiv:2010.13404 [cs.CL]
  (or arXiv:2010.13404v1 [cs.CL] for this version)

Submission history

From: Rifat Rahman [view email]
[v1] Mon, 26 Oct 2020 08:00:48 GMT (426kb,D)

Link back to: arXiv, form interface, contact.