Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Learning a Single Neuron with Gradient Methods
(Submitted on 15 Jan 2020 (v1), last revised 27 Feb 2022 (this version, v3))
Abstract: We consider the fundamental problem of learning a single neuron $x \mapsto\sigma(w^\top x)$ using standard gradient methods. As opposed to previous works, which considered specific (and not always realistic) input distributions and activation functions $\sigma(\cdot)$, we ask whether a more general result is attainable, under milder assumptions. On the one hand, we show that some assumptions on the distribution and the activation function are necessary. On the other hand, we prove positive guarantees under mild assumptions, which go beyond those studied in the literature so far. We also point out and study the challenges in further strengthening and generalizing our results.
Submission history
From: Gilad Yehudai [view email][v1] Wed, 15 Jan 2020 10:02:45 GMT (220kb,D)
[v2] Tue, 11 Feb 2020 10:46:34 GMT (222kb,D)
[v3] Sun, 27 Feb 2022 11:59:15 GMT (222kb,D)
Link back to: arXiv, form interface, contact.