We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: An error analysis of generative adversarial networks for learning distributions

Abstract: This paper studies how well generative adversarial networks (GANs) learn probability distributions from finite samples. Our main results establish the convergence rates of GANs under a collection of integral probability metrics defined through H\"older classes, including the Wasserstein distance as a special case. We also show that GANs are able to adaptively learn data distributions with low-dimensional structures or have H\"older densities, when the network architectures are chosen properly. In particular, for distributions concentrated around a low-dimensional set, we show that the learning rates of GANs do not depend on the high ambient dimension, but on the lower intrinsic dimension. Our analysis is based on a new oracle inequality decomposing the estimation error into the generator and discriminator approximation error and the statistical error, which may be of independent interest.
Subjects: Machine Learning (cs.LG); Statistics Theory (math.ST); Machine Learning (stat.ML)
Journal reference: Journal of Machine Learning Research, 23(116):1-43, 2022
Cite as: arXiv:2105.13010 [cs.LG]
  (or arXiv:2105.13010v5 [cs.LG] for this version)

Submission history

From: Yunfei Yang [view email]
[v1] Thu, 27 May 2021 08:55:19 GMT (44kb)
[v2] Thu, 3 Jun 2021 07:28:00 GMT (45kb)
[v3] Sat, 12 Jun 2021 02:19:06 GMT (466kb)
[v4] Thu, 1 Jul 2021 03:03:30 GMT (44kb)
[v5] Sat, 16 Apr 2022 02:55:52 GMT (49kb,D)

Link back to: arXiv, form interface, contact.