We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Universal Equivariant Multilayer Perceptrons

Abstract: Group invariant and equivariant Multilayer Perceptrons (MLP), also known as Equivariant Networks, have achieved remarkable success in learning on a variety of data structures, such as sequences, images, sets, and graphs. Using tools from group theory, this paper proves the universality of a broad class of equivariant MLPs with a single hidden layer. In particular, it is shown that having a hidden layer on which the group acts regularly is sufficient for universal equivariance (invariance). A corollary is unconditional universality of equivariant MLPs for Abelian groups, such as CNNs with a single hidden layer. A second corollary is the universality of equivariant MLPs with a high-order hidden layer, where we give both group-agnostic bounds and means for calculating group-specific bounds on the order of hidden layer that guarantees universal equivariance (invariance).
Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Group Theory (math.GR); Machine Learning (stat.ML)
Cite as: arXiv:2002.02912 [cs.LG]
  (or arXiv:2002.02912v2 [cs.LG] for this version)

Submission history

From: Siamak Ravanbakhsh [view email]
[v1] Fri, 7 Feb 2020 17:25:59 GMT (256kb)
[v2] Wed, 24 Jun 2020 22:28:22 GMT (240kb,D)

Link back to: arXiv, form interface, contact.