We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Statistics Theory

Title: Approximate Co-Sufficient Sampling for Goodness-of-fit Tests and Synthetic Data

Abstract: Co-sufficient sampling refers to resampling the data conditional on a sufficient statistic, a useful technique for statistical problems such as goodness-of-fit tests, model selection, and confidence interval construction; it is also a powerful tool to generate synthetic data which limits the disclosure risk of sensitive data. However, sampling from such conditional distributions is both technically and computationally challenging, and is inapplicable in models without low-dimensional sufficient statistics.
We study an indirect inference approach to approximate co-sufficient sampling, which only requires an efficient statistic rather than a sufficient statistic. Given an efficient estimator, we prove that the expected KL divergence goes to zero between the true conditional distribution and the resulting approximate distribution. We also propose a one-step approximate solution to the optimization problem that preserves the original estimator with an error of $o_p(n^{-1/2})$, which suffices for asymptotic optimality. The one-step method is easily implemented, highly computationally efficient, and applicable to a wide variety of models, only requiring the ability to sample from the model and compute an efficient statistic. We implement our methods via simulations to tackle problems in synthetic data, hypothesis testing, and differential privacy.
Comments: 35 pages double spaced, before references
Subjects: Statistics Theory (math.ST); Cryptography and Security (cs.CR); Computation (stat.CO)
Cite as: arXiv:2006.02397 [math.ST]
  (or arXiv:2006.02397v3 [math.ST] for this version)

Submission history

From: Jordan Awan [view email]
[v1] Wed, 3 Jun 2020 17:12:11 GMT (38kb,D)
[v2] Thu, 4 Jun 2020 19:15:28 GMT (31kb,D)
[v3] Fri, 12 Feb 2021 18:12:09 GMT (82kb,D)
[v4] Fri, 12 Nov 2021 14:58:23 GMT (70kb,D)
[v5] Wed, 10 Aug 2022 16:45:25 GMT (51kb,D)

Link back to: arXiv, form interface, contact.