We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: Why the Rich Get Richer? On the Balancedness of Random Partition Models

Abstract: Random partition models are widely used in Bayesian methods for various clustering tasks, such as mixture models, topic models, and community detection problems. While the number of clusters induced by random partition models has been studied extensively, another important model property regarding the balancedness of partition has been largely neglected. We formulate a framework to define and theoretically study the balancedness of exchangeable random partition models, by analyzing how a model assigns probabilities to partitions with different levels of balancedness. We demonstrate that the "rich-get-richer" characteristic of many existing popular random partition models is an inevitable consequence of two common assumptions: product-form exchangeability and projectivity. We propose a principled way to compare the balancedness of random partition models, which gives a better understanding of what model works better and what doesn't for different applications. We also introduce the "rich-get-poorer" random partition models and illustrate their application to entity resolution tasks.
Comments: Accepted to 2022 International Conference on Machine Learning (ICML 2022)
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Methodology (stat.ME)
Cite as: arXiv:2201.12697 [stat.ML]
  (or arXiv:2201.12697v2 [stat.ML] for this version)

Submission history

From: Changwoo Lee [view email]
[v1] Sun, 30 Jan 2022 01:19:41 GMT (4941kb,D)
[v2] Sat, 18 Jun 2022 01:35:19 GMT (2957kb,D)

Link back to: arXiv, form interface, contact.