We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CL

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computation and Language

Title: Large Language Models Offer an Alternative to the Traditional Approach of Topic Modelling

Abstract: Topic modelling, as a well-established unsupervised technique, has found extensive use in automatically detecting significant topics within a corpus of documents. However, classic topic modelling approaches (e.g., LDA) have certain drawbacks, such as the lack of semantic understanding and the presence of overlapping topics. In this work, we investigate the untapped potential of large language models (LLMs) as an alternative for uncovering the underlying topics within extensive text corpora. To this end, we introduce a framework that prompts LLMs to generate topics from a given set of documents and establish evaluation protocols to assess the clustering efficacy of LLMs. Our findings indicate that LLMs with appropriate prompts can stand out as a viable alternative, capable of generating relevant topic titles and adhering to human guidelines to refine and merge topics. Through in-depth experiments and evaluation, we summarise the advantages and constraints of employing LLMs in topic extraction.
Comments: Accepted at LREC-COLING 2024
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2403.16248 [cs.CL]
  (or arXiv:2403.16248v2 [cs.CL] for this version)

Submission history

From: Yida Mu [view email]
[v1] Sun, 24 Mar 2024 17:39:51 GMT (6374kb,D)
[v2] Tue, 26 Mar 2024 17:46:26 GMT (6374kb,D)

Link back to: arXiv, form interface, contact.