We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Coresets via Bilevel Optimization for Continual Learning and Streaming

Abstract: Coresets are small data summaries that are sufficient for model training. They can be maintained online, enabling efficient handling of large data streams under resource constraints. However, existing constructions are limited to simple models such as k-means and logistic regression. In this work, we propose a novel coreset construction via cardinality-constrained bilevel optimization. We show how our framework can efficiently generate coresets for deep neural networks, and demonstrate its empirical benefits in continual learning and in streaming settings.
Comments: NeurIPS 2020
Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)
Cite as: arXiv:2006.03875 [cs.LG]
  (or arXiv:2006.03875v2 [cs.LG] for this version)

Submission history

From: Zalán Borsos [view email]
[v1] Sat, 6 Jun 2020 14:20:25 GMT (1834kb,D)
[v2] Thu, 22 Oct 2020 17:53:39 GMT (3397kb,D)

Link back to: arXiv, form interface, contact.