Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Learning Invariances in Neural Networks
(Submitted on 22 Oct 2020 (v1), last revised 1 Dec 2020 (this version, v2))
Abstract: Invariances to translations have imbued convolutional neural networks with powerful generalization properties. However, we often do not know a priori what invariances are present in the data, or to what extent a model should be invariant to a given symmetry group. We show how to \emph{learn} invariances and equivariances by parameterizing a distribution over augmentations and optimizing the training loss simultaneously with respect to the network parameters and augmentation parameters. With this simple procedure we can recover the correct set and extent of invariances on image classification, regression, segmentation, and molecular property prediction from a large space of augmentations, on training data alone.
Submission history
From: Andrew Wilson [view email][v1] Thu, 22 Oct 2020 17:18:48 GMT (1323kb,D)
[v2] Tue, 1 Dec 2020 17:38:11 GMT (1319kb,D)
Link back to: arXiv, form interface, contact.