We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Data Augementation with Polya Inverse Gamma

Abstract: We use the theory of normal variance-mean mixtures to derive a data augmentation scheme for models that include gamma functions. Our methodology applies to many situations in statistics and machine learning, including Multinomial-Dirichlet distributions, Negative binomial regression, Poisson-Gamma hierarchical models, Extreme value models, to name but a few. All of those models include a gamma function which does not admit a natural conjugate prior distribution providing a significant challenge to inference and prediction. To provide a data augmentation strategy, we construct and develop the theory of the class of P\'olya Inverse Gamma distributions. This allows scalable EM and MCMC algorithms to be developed. We illustrate our methodology on a number of examples, including gamma shape inference, negative binomial regression and Dirichlet allocation. Finally, we conclude with directions for future research.
Subjects: Methodology (stat.ME); Computation (stat.CO); Machine Learning (stat.ML)
Cite as: arXiv:1905.12141 [stat.ME]
  (or arXiv:1905.12141v3 [stat.ME] for this version)

Submission history

From: Jingyu He [view email]
[v1] Wed, 29 May 2019 00:15:56 GMT (47kb,D)
[v2] Mon, 21 Jun 2021 14:44:58 GMT (355kb,D)
[v3] Sun, 1 May 2022 14:51:39 GMT (621kb,D)

Link back to: arXiv, form interface, contact.