We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Differential Private Hogwild! over Distributed Local Data Sets

Abstract: We consider the Hogwild! setting where clients use local SGD iterations with Gaussian based Differential Privacy (DP) for their own local data sets with the aim of (1) jointly converging to a global model (by interacting at a round to round basis with a centralized server that aggregates local SGD updates into a global model) while (2) keeping each local data set differentially private with respect to the outside world (this includes all other clients who can monitor client-server interactions). We show for a broad class of sample size sequences (this defines the number of local SGD iterations for each round) that a local data set is $(\epsilon,\delta)$-DP if the standard deviation $\sigma$ of the added Gaussian noise per round interaction with the centralized server is at least $\sqrt{2(\epsilon+ \ln(1/\delta))/\epsilon}$.
Comments: arXiv admin note: text overlap with arXiv:2007.09208
Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Machine Learning (stat.ML)
Cite as: arXiv:2102.09030 [cs.LG]
  (or arXiv:2102.09030v1 [cs.LG] for this version)

Submission history

From: Ngoc Toan Nguyen [view email]
[v1] Wed, 17 Feb 2021 21:19:39 GMT (18148kb,D)
[v2] Mon, 14 Jun 2021 21:05:08 GMT (1727kb,D)
[v3] Tue, 19 Oct 2021 23:07:08 GMT (1755kb,D)
[v4] Tue, 1 Feb 2022 00:27:02 GMT (18773kb,D)

Link back to: arXiv, form interface, contact.