Current browse context:
math.OC
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: A One-bit, Comparison-Based Gradient Estimator
(Submitted on 6 Oct 2020 (v1), last revised 23 Apr 2022 (this version, v3))
Abstract: We study zeroth-order optimization for convex functions where we further assume that function evaluations are unavailable. Instead, one only has access to a $\textit{comparison oracle}$, which given two points $x$ and $y$ returns a single bit of information indicating which point has larger function value, $f(x)$ or $f(y)$. By treating the gradient as an unknown signal to be recovered, we show how one can use tools from one-bit compressed sensing to construct a robust and reliable estimator of the normalized gradient. We then propose an algorithm, coined SCOBO, that uses this estimator within a gradient descent scheme. We show that when $f(x)$ has some low dimensional structure that can be exploited, SCOBO outperforms the state-of-the-art in terms of query complexity. Our theoretical claims are verified by extensive numerical experiments.
Submission history
From: HanQin Cai [view email][v1] Tue, 6 Oct 2020 05:01:38 GMT (1583kb,D)
[v2] Tue, 19 Jan 2021 10:24:58 GMT (1582kb,D)
[v3] Sat, 23 Apr 2022 08:35:35 GMT (1653kb,D)
Link back to: arXiv, form interface, contact.