Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Persistent Homology Captures the Generalization of Neural Networks Without A Validation Set
(Submitted on 31 May 2021)
Abstract: The training of neural networks is usually monitored with a validation (holdout) set to estimate the generalization of the model. This is done instead of measuring intrinsic properties of the model to determine whether it is learning appropriately. In this work, we suggest studying the training of neural networks with Algebraic Topology, specifically Persistent Homology (PH). Using simplicial complex representations of neural networks, we study the PH diagram distance evolution on the neural network learning process with different architectures and several datasets. Results show that the PH diagram distance between consecutive neural network states correlates with the validation accuracy, implying that the generalization error of a neural network could be intrinsically estimated without any holdout set.
Submission history
From: Asier Gutiérrez-Fandiño [view email][v1] Mon, 31 May 2021 09:17:31 GMT (12060kb,D)
Link back to: arXiv, form interface, contact.