Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Optimal No-regret Learning in Repeated First-price Auctions
(Submitted on 22 Mar 2020 (v1), last revised 4 Mar 2024 (this version, v7))
Abstract: We study online learning in repeated first-price auctions where a bidder, only observing the winning bid at the end of each auction, learns to adaptively bid in order to maximize her cumulative payoff. To achieve this goal, the bidder faces censored feedback: if she wins the bid, then she is not able to observe the highest bid of the other bidders, which we assume is \textit{iid} drawn from an unknown distribution. In this paper, we develop the first learning algorithm that achieves a near-optimal $\widetilde{O}(\sqrt{T})$ regret bound, by exploiting two structural properties of first-price auctions, i.e. the specific feedback structure and payoff function.
We first formulate the feedback structure in first-price auctions as partially ordered contextual bandits, a combination of the graph feedback across actions (bids), the cross learning across contexts (private values), and a partial order over the contexts. We establish both strengths and weaknesses of this framework, by showing a curious separation that a regret nearly independent of the action/context sizes is possible under stochastic contexts, but is impossible under adversarial contexts. In particular, this framework leads to an $O(\sqrt{T}\log^{2.5}T)$ regret for first-price auctions when the bidder's private values are \emph{iid}.
Despite the limitation of the above framework, we further exploit the special payoff function of first-price auctions to develop a sample-efficient algorithm even in the presence of adversarially generated private values. We establish an $O(\sqrt{T}\log^3 T)$ regret bound for this algorithm, hence providing a complete characterization of optimal learning guarantees for first-price auctions.
Submission history
From: Yanjun Han [view email][v1] Sun, 22 Mar 2020 03:32:09 GMT (43kb)
[v2] Wed, 8 Apr 2020 20:56:11 GMT (43kb)
[v3] Tue, 14 Apr 2020 06:42:43 GMT (47kb)
[v4] Fri, 8 May 2020 22:18:17 GMT (49kb)
[v5] Fri, 15 Jul 2022 03:07:22 GMT (293kb,D)
[v6] Thu, 18 May 2023 03:55:39 GMT (295kb,D)
[v7] Mon, 4 Mar 2024 23:27:02 GMT (293kb,D)
Link back to: arXiv, form interface, contact.