We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.NE

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Neural and Evolutionary Computing

Title: Feature discriminativity estimation in CNNs for transfer learning

Abstract: The purpose of feature extraction on convolutional neural networks is to reuse deep representations learnt for a pre-trained model to solve a new, potentially unrelated problem. However, raw feature extraction from all layers is unfeasible given the massive size of these networks. Recently, a supervised method using complexity reduction was proposed, resulting in significant improvements in performance for transfer learning tasks. This approach first computes the discriminative power of features, and then discretises them using thresholds computed for the task. In this paper, we analyse the behaviour of these thresholds, with the purpose of finding a methodology for their estimation. After a comprehensive study, we find a very strong correlation between problem size and threshold value, with coefficient of determination above 90%. These results allow us to propose a unified model for threshold estimation, with potential application to transfer learning tasks.
Comments: Presented in the 22nd International Conference of the Catalan Association for Artificial Intelligence (CCIA 19)
Subjects: Neural and Evolutionary Computing (cs.NE); Machine Learning (cs.LG)
Journal reference: Volume 319: Artificial Intelligence Research and Development 2019
DOI: 10.3233/FAIA190109
Cite as: arXiv:1911.03332 [cs.NE]
  (or arXiv:1911.03332v1 [cs.NE] for this version)

Submission history

From: Victor Gimenez-Abalos [view email]
[v1] Fri, 8 Nov 2019 15:37:25 GMT (647kb,D)

Link back to: arXiv, form interface, contact.