We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: The distance between the weights of the neural network is meaningful

Abstract: In the application of neural networks, we need to select a suitable model based on the problem complexity and the dataset scale. To analyze the network's capacity, quantifying the information learned by the network is necessary. This paper proves that the distance between the neural network weights in different training stages can be used to estimate the information accumulated by the network in the training process directly. The experiment results verify the utility of this method. An application of this method related to the label corruption is shown at the end.
Comments: 10 pages, 13 figure
Subjects: Machine Learning (cs.LG)
MSC classes: 94-10 (Primary) 47N30(Secondary)
ACM classes: I.2.4
Cite as: arXiv:2102.00396 [cs.LG]
  (or arXiv:2102.00396v1 [cs.LG] for this version)

Submission history

From: Liqun Yang [view email]
[v1] Sun, 31 Jan 2021 06:44:49 GMT (742kb,D)

Link back to: arXiv, form interface, contact.