Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Sample Efficient Subspace-based Representations for Nonlinear Meta-Learning
(Submitted on 14 Feb 2021 (v1), last revised 26 Feb 2021 (this version, v2))
Abstract: Constructing good representations is critical for learning complex tasks in a sample efficient manner. In the context of meta-learning, representations can be constructed from common patterns of previously seen tasks so that a future task can be learned quickly. While recent works show the benefit of subspace-based representations, such results are limited to linear-regression tasks. This work explores a more general class of nonlinear tasks with applications ranging from binary classification, generalized linear models and neural nets. We prove that subspace-based representations can be learned in a sample-efficient manner and provably benefit future tasks in terms of sample complexity. Numerical results verify the theoretical predictions in classification and neural-network regression tasks.
Submission history
From: Yue Sun [view email][v1] Sun, 14 Feb 2021 17:40:04 GMT (1049kb,D)
[v2] Fri, 26 Feb 2021 19:06:20 GMT (2009kb,D)
Link back to: arXiv, form interface, contact.