Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Matching while Learning
(Submitted on 15 Mar 2016 (v1), revised 1 Oct 2018 (this version, v3), latest version 5 Aug 2020 (v7))
Abstract: We consider the problem faced by a service platform that needs to match supply with demand, but also to learn attributes of new arrivals in order to match them better in the future. We introduce a benchmark model with heterogeneous workers and jobs that arrive over time. Job types are known to the platform, but worker types are unknown and must be learned by observing match outcomes. Workers depart after performing a certain number of jobs. The payoff from a match depends on the pair of types and the goal is to maximize the steady-state rate of accumulation of payoff.
Our main contribution is a complete characterization of the structure of the optimal policy in the limit that each worker performs many jobs. The platform faces a trade-off for each worker between myopically maximizing payoffs (exploitation) and learning the type of the worker (\emph{exploration}). This creates a multitude of multi-armed bandit problems, one for each worker, coupled together by the constraint on the availability of jobs of different types (capacity constraints). We find that the platform should estimate a shadow price for each job type, and use the payoffs adjusted by these prices, first, to determine its learning goals and then, for each worker, (i) to balance learning with payoffs during the "exploration phase", and (ii) to myopically match after it has achieved its learning goals during the "exploitation phase."
Submission history
From: Vijay Kamble [view email][v1] Tue, 15 Mar 2016 04:29:31 GMT (328kb,D)
[v2] Sun, 18 Jun 2017 00:11:06 GMT (148kb,D)
[v3] Mon, 1 Oct 2018 00:39:01 GMT (818kb,D)
[v4] Wed, 28 Nov 2018 21:36:16 GMT (818kb,D)
[v5] Sat, 7 Dec 2019 18:16:30 GMT (1326kb,D)
[v6] Thu, 23 Apr 2020 19:49:49 GMT (1350kb,D)
[v7] Wed, 5 Aug 2020 22:17:03 GMT (1351kb,D)
Link back to: arXiv, form interface, contact.