Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Learning to Optimize Computational Resources: Frugal Training with Generalization Guarantees
(Submitted on 26 May 2019 (v1), last revised 21 Nov 2020 (this version, v3))
Abstract: Algorithms typically come with tunable parameters that have a considerable impact on the computational resources they consume. Too often, practitioners must hand-tune the parameters, a tedious and error-prone task. A recent line of research provides algorithms that return nearly-optimal parameters from within a finite set. These algorithms can be used when the parameter space is infinite by providing as input a random sample of parameters. This data-independent discretization, however, might miss pockets of nearly-optimal parameters: prior research has presented scenarios where the only viable parameters lie within an arbitrarily small region. We provide an algorithm that learns a finite set of promising parameters from within an infinite set. Our algorithm can help compile a configuration portfolio, or it can be used to select the input to a configuration algorithm for finite parameter spaces. Our approach applies to any configuration problem that satisfies a simple yet ubiquitous structure: the algorithm's performance is a piecewise constant function of its parameters. Prior research has exhibited this structure in domains from integer programming to clustering.
Submission history
From: Ellen Vitercik [view email][v1] Sun, 26 May 2019 15:43:50 GMT (110kb,D)
[v2] Mon, 9 Sep 2019 14:41:01 GMT (458kb,D)
[v3] Sat, 21 Nov 2020 00:59:08 GMT (458kb,D)
Link back to: arXiv, form interface, contact.