Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Meta-Learning with Variational Bayes
(Submitted on 3 Mar 2021 (this version), latest version 25 Mar 2021 (v2))
Abstract: The field of meta-learning seeks to improve the ability of today's machine learning systems to adapt efficiently to small amounts of data. Typically this is accomplished by training a system with a parametrized update rule to improve a task-relevant objective based on supervision or a reward function. However, in many domains of practical interest, task data is unlabeled, or reward functions are unavailable. In this paper we introduce a new approach to address the more general problem of generative meta-learning, which we argue is an important prerequisite for obtaining human-level cognitive flexibility in artificial agents, and can benefit many practical applications along the way. Our contribution leverages the AEVB framework and mean-field variational Bayes, and creates fast-adapting latent-space generative models. At the heart of our contribution is a new result, showing that for a broad class of deep generative latent variable models, the relevant VB updates do not depend on any generative neural network.
Submission history
From: Lucas Lingle [view email][v1] Wed, 3 Mar 2021 09:02:01 GMT (34314kb,D)
[v2] Thu, 25 Mar 2021 04:05:36 GMT (34314kb,D)
Link back to: arXiv, form interface, contact.