We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Universal Equivariant Multilayer Perceptrons

Abstract: Group invariant and equivariant Multilayer Perceptrons (MLP), also known as Equivariant Networks, have achieved remarkable success in learning on a variety of data structures, such as sequences, images, sets, and graphs. Using tools from group theory, this paper proves the universality of a broad class of equivariant MLPs with a single hidden layer. In particular, it is shown that having a hidden layer on which the group acts regularly is sufficient for universal equivariance. Next, Burnside's table of marks is used to decompose product spaces. It is shown that the product of two G-sets always contains an orbit larger than the input orbits. Therefore high order hidden layers inevitably contain a regular orbit, leading to the universality of the corresponding MLP. It is shown that with an order larger than the logarithm of the size of the stabilizer group, a high-order equivariant MLP is equivariant universal.
Subjects: Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE); Group Theory (math.GR); Machine Learning (stat.ML)
Cite as: arXiv:2002.02912 [cs.LG]
  (or arXiv:2002.02912v1 [cs.LG] for this version)

Submission history

From: Siamak Ravanbakhsh [view email]
[v1] Fri, 7 Feb 2020 17:25:59 GMT (256kb)
[v2] Wed, 24 Jun 2020 22:28:22 GMT (240kb,D)

Link back to: arXiv, form interface, contact.