References & Citations
Computer Science > Computation and Language
Title: A Comprehensive Empirical Evaluation of Existing Word Embedding Approaches
(Submitted on 13 Mar 2023 (v1), last revised 2 Mar 2024 (this version, v2))
Abstract: Vector-based word representations help countless Natural Language Processing (NLP) tasks capture the language's semantic and syntactic regularities. In this paper, we present the characteristics of existing word embedding approaches and analyze them with regard to many classification tasks. We categorize the methods into two main groups - Traditional approaches mostly use matrix factorization to produce word representations, and they are not able to capture the semantic and syntactic regularities of the language very well. On the other hand, Neural-network-based approaches can capture sophisticated regularities of the language and preserve the word relationships in the generated word representations. We report experimental results on multiple classification tasks and highlight the scenarios where one approach performs better than the rest.
Submission history
From: Obaidullah Zaland [view email][v1] Mon, 13 Mar 2023 15:34:19 GMT (151kb,D)
[v2] Sat, 2 Mar 2024 19:19:44 GMT (151kb,D)
Link back to: arXiv, form interface, contact.