Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: A Probabilistic Model for Discriminative and Neuro-Symbolic Semi-Supervised Learning
(Submitted on 10 Jun 2020 (v1), last revised 31 May 2021 (this version, v4))
Abstract: Much progress has been made in semi-supervised learning (SSL) by combining methods that exploit different aspects of the data distribution, e.g. consistency regularisation relies on properties of $p(x)$, whereas entropy minimisation pertains to the label distribution $p(y|x)$. Focusing on the latter, we present a probabilistic model for discriminative SSL, that mirrors its classical generative counterpart. Under the assumption $y|x$ is deterministic, the prior over latent variables becomes discrete. We show that several well-known SSL methods can be interpreted as approximating this prior, and can be improved upon. We extend the discriminative model to neuro-symbolic SSL, where label features satisfy logical rules, by showing such rules relate directly to the above prior, thus justifying a family of methods that link statistical learning and logical reasoning, and unifying them with regular SSL.
Submission history
From: Carl Allen [view email][v1] Wed, 10 Jun 2020 15:30:54 GMT (644kb,D)
[v2] Tue, 25 Aug 2020 16:34:19 GMT (514kb,D)
[v3] Thu, 18 Feb 2021 13:04:04 GMT (607kb,D)
[v4] Mon, 31 May 2021 12:20:00 GMT (664kb,D)
Link back to: arXiv, form interface, contact.