We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Understanding Sinusoidal Neural Networks

Authors: Tiago Novello
Abstract: In this work, we investigate the representation capacity of multilayer perceptron networks that use the sine as activation function - sinusoidal neural networks. We show that the layer composition in such networks compacts information. For this, we prove that the composition of sinusoidal layers expands as a sum of sines consisting of a large number of new frequencies given by linear combinations of the weights of the network's first layer. We provide the expression of the corresponding amplitudes in terms of the Bessel functions and give an upper bound for them that can be used to control the resulting approximation.
Subjects: Machine Learning (cs.LG)
Cite as: arXiv:2212.01833 [cs.LG]
  (or arXiv:2212.01833v1 [cs.LG] for this version)

Submission history

From: Tiago Novello [view email]
[v1] Sun, 4 Dec 2022 14:50:22 GMT (219kb,D)

Link back to: arXiv, form interface, contact.