We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Private Distributed Mean Estimation

Abstract: Ever since its proposal, differential privacy has become the golden standard for rigorous privacy protection. Output perturbation is the most widely used differentially private mechanism. It works by adding calibrated noise drawn from the real domain to the output. However, the finite computers can only represent real numbers to a given machine precision. To guarantee the strictness of differential privacy under fixed precision, several pioneering works proposed to use noise drawn from discrete for differential privacy. However, discrete differentially private mechanisms are not used in dense tasks such as deep learning because of the lack of tight composition theorem like moments accountant. In this paper, we prove R\'enyi differential privacy for discrete Gaussian mechanism. Thus, we can directly use analytical moments accountant (\cite{wang2018subsampled}) to provide tight composition for distributed mean estimation.
Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Methodology (stat.ME)
Cite as: arXiv:2006.13039 [stat.ML]
  (or arXiv:2006.13039v1 [stat.ML] for this version)

Submission history

From: Lun Wang [view email]
[v1] Mon, 22 Jun 2020 06:46:11 GMT (218kb)
[v2] Fri, 2 Oct 2020 19:30:40 GMT (100kb)
[v3] Sun, 1 Nov 2020 22:22:17 GMT (94kb)
[v4] Mon, 16 Nov 2020 03:20:21 GMT (100kb)
[v5] Sat, 2 Jan 2021 22:02:32 GMT (100kb)

Link back to: arXiv, form interface, contact.