Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Scalars are universal: Equivariant machine learning, structured like classical physics
(Submitted on 11 Jun 2021 (v1), last revised 7 Feb 2023 (this version, v4))
Abstract: There has been enormous progress in the last few years in designing neural networks that respect the fundamental symmetries and coordinate freedoms of physical law. Some of these frameworks make use of irreducible representations, some make use of high-order tensor objects, and some apply symmetry-enforcing constraints. Different physical laws obey different combinations of fundamental symmetries, but a large fraction (possibly all) of classical physics is equivariant to translation, rotation, reflection (parity), boost (relativity), and permutations. Here we show that it is simple to parameterize universally approximating polynomial functions that are equivariant under these symmetries, or under the Euclidean, Lorentz, and Poincar\'e groups, at any dimensionality $d$. The key observation is that nonlinear O($d$)-equivariant (and related-group-equivariant) functions can be universally expressed in terms of a lightweight collection of scalars -- scalar products and scalar contractions of the scalar, vector, and tensor inputs. We complement our theory with numerical examples that show that the scalar-based method is simple, efficient, and scalable.
Submission history
From: Soledad Villar [view email][v1] Fri, 11 Jun 2021 20:51:38 GMT (52kb)
[v2] Fri, 29 Oct 2021 18:49:04 GMT (53kb,D)
[v3] Fri, 21 Oct 2022 01:14:58 GMT (74kb,D)
[v4] Tue, 7 Feb 2023 21:12:30 GMT (73kb,D)
Link back to: arXiv, form interface, contact.