Current browse context:
math.ST
Change to browse by:
References & Citations
Mathematics > Statistics Theory
Title: Information criteria for non-normalized models
(Submitted on 15 May 2019 (v1), last revised 27 Jul 2021 (this version, v5))
Abstract: Many statistical models are given in the form of non-normalized densities with an intractable normalization constant. Since maximum likelihood estimation is computationally intensive for these models, several estimation methods have been developed which do not require explicit computation of the normalization constant, such as noise contrastive estimation (NCE) and score matching. However, model selection methods for general non-normalized models have not been proposed so far. In this study, we develop information criteria for non-normalized models estimated by NCE or score matching. They are approximately unbiased estimators of discrepancy measures for non-normalized models. Simulation results and applications to real data demonstrate that the proposed criteria enable selection of the appropriate non-normalized model in a data-driven manner.
Submission history
From: Takeru Matsuda [view email][v1] Wed, 15 May 2019 06:57:47 GMT (66kb)
[v2] Sat, 25 Apr 2020 08:33:30 GMT (101kb)
[v3] Thu, 3 Dec 2020 09:08:17 GMT (134kb)
[v4] Fri, 18 Jun 2021 07:31:56 GMT (137kb)
[v5] Tue, 27 Jul 2021 06:00:47 GMT (137kb)
Link back to: arXiv, form interface, contact.