We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LO

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Logic in Computer Science

Title: Reverse Derivative Ascent: A Categorical Approach to Learning Boolean Circuits

Authors: Paul Wilson (University of Southampton), Fabio Zanasi (University College London)
Abstract: We introduce Reverse Derivative Ascent: a categorical analogue of gradient based methods for machine learning. Our algorithm is defined at the level of so-called reverse differential categories. It can be used to learn the parameters of models which are expressed as morphisms of such categories. Our motivating example is boolean circuits: we show how our algorithm can be applied to such circuits by using the theory of reverse differential categories. Note our methodology allows us to learn the parameters of boolean circuits directly, in contrast to existing binarised neural network approaches. Moreover, we demonstrate its empirical value by giving experimental results on benchmark machine learning datasets.
Comments: In Proceedings ACT 2020, arXiv:2101.07888
Subjects: Logic in Computer Science (cs.LO); Machine Learning (cs.LG)
Journal reference: EPTCS 333, 2021, pp. 247-260
DOI: 10.4204/EPTCS.333.17
Cite as: arXiv:2101.10488 [cs.LO]
  (or arXiv:2101.10488v1 [cs.LO] for this version)

Submission history

From: EPTCS [view email]
[v1] Tue, 26 Jan 2021 00:07:20 GMT (36kb,D)

Link back to: arXiv, form interface, contact.