We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Stochastic Divergence Minimization for Biterm Topic Model

Abstract: As the emergence and the thriving development of social networks, a huge number of short texts are accumulated and need to be processed. Inferring latent topics of collected short texts is useful for understanding its hidden structure and predicting new contents. Unlike conventional topic models such as latent Dirichlet allocation (LDA), a biterm topic model (BTM) was recently proposed for short texts to overcome the sparseness of document-level word co-occurrences by directly modeling the generation process of word pairs. Stochastic inference algorithms based on collapsed Gibbs sampling (CGS) and collapsed variational inference have been proposed for BTM. However, they either require large computational complexity, or rely on very crude estimation. In this work, we develop a stochastic divergence minimization inference algorithm for BTM to estimate latent topics more accurately in a scalable way. Experiments demonstrate the superiority of our proposed algorithm compared with existing inference algorithms.
Comments: 19 pages, 4 figures
Subjects: Machine Learning (stat.ML)
DOI: 10.1587/transinf.2017EDP7310
Cite as: arXiv:1705.00394 [stat.ML]
  (or arXiv:1705.00394v1 [stat.ML] for this version)

Submission history

From: Zhenghang Cui [view email]
[v1] Mon, 1 May 2017 01:05:09 GMT (89kb)

Link back to: arXiv, form interface, contact.