References & Citations
Computer Science > Computation and Language
Title: Robust and Consistent Estimation of Word Embedding for Bangla Language by fine-tuning Word2Vec Model
(Submitted on 26 Oct 2020 (v1), last revised 3 May 2021 (this version, v3))
Abstract: Word embedding or vector representation of word holds syntactical and semantic characteristics of a word which can be an informative feature for any machine learning-based models of natural language processing. There are several deep learning-based models for the vectorization of words like word2vec, fasttext, gensim, glove, etc. In this study, we analyze word2vec model for learning word vectors by tuning different hyper-parameters and present the most effective word embedding for Bangla language. For testing the performances of different word embeddings generated by fine-tuning of word2vec model, we perform both intrinsic and extrinsic evaluations. We cluster the word vectors to examine the relational similarity of words for intrinsic evaluation and also use different word embeddings as the feature of news article classifier for extrinsic evaluation. From our experiment, we discover that the word vectors with 300 dimensions, generated from "skip-gram" method of word2vec model using the sliding window size of 4, are giving the most robust vector representations for Bangla language.
Submission history
From: Rifat Rahman [view email][v1] Mon, 26 Oct 2020 08:00:48 GMT (426kb,D)
[v2] Tue, 12 Jan 2021 13:51:27 GMT (0kb,I)
[v3] Mon, 3 May 2021 20:58:27 GMT (429kb,D)
Link back to: arXiv, form interface, contact.