Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Computation and Language
Title: A Hybrid Approach Towards Two Stage Bengali Question Classification Utilizing Smart Data Balancing Technique
(Submitted on 30 Nov 2019 (v1), last revised 3 Mar 2020 (this version, v3))
Abstract: Question classification (QC) is the primary step of the Question Answering (QA) system. Question Classification (QC) system classifies the questions in particular classes so that Question Answering (QA) System can provide correct answers for the questions. Our system categorizes the factoid type questions asked in natural language after extracting features of the questions. We present a two stage QC system for Bengali. It utilizes one dimensional convolutional neural network for classifying questions into coarse classes in the first stage. Word2vec representation of existing words of the question corpus have been constructed and used for assisting 1D CNN. A smart data balancing technique has been employed for giving data hungry convolutional neural network the advantage of a greater number of effective samples to learn from. For each coarse class, a separate Stochastic Gradient Descent (SGD) based classifier has been used in order to differentiate among the finer classes within that coarse class. TF-IDF representation of each word has been used as feature for the SGD classifiers implemented as part of second stage classification. Experiments show the effectiveness of our proposed method for Bengali question classification.
Submission history
From: Chowdhury Rahman [view email][v1] Sat, 30 Nov 2019 04:00:31 GMT (679kb,D)
[v2] Sun, 8 Dec 2019 02:15:32 GMT (1337kb,D)
[v3] Tue, 3 Mar 2020 03:53:55 GMT (1339kb,D)
Link back to: arXiv, form interface, contact.