We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.AP

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Applications

Title: Randomization and The Pernicious Effects of Limited Budgets on Auction Experiments

Abstract: Buyers (e.g., advertisers) often have limited financial and processing resources, and so their participation in auctions is throttled. Changes to auctions may affect bids or throttling and any change may affect what winners pay. This paper shows that if an A/B experiment affects only bids, then the observed treatment effect is unbiased when all the bidders in an auction are randomly assigned to A or B but it can be severely biased otherwise, even in the absence of throttling. Experiments that affect throttling algorithms can also be badly biased, but the bias can be substantially reduced if the budget for each advertiser in the experiment is allocated to separate pots for the A and B arms of the experiment.
Comments: Appeared in Proceedings of the 19th International Conference on Artificial Intelligence and Statistics (AISTATS) 2016
Subjects: Applications (stat.AP); Computer Science and Game Theory (cs.GT)
Cite as: arXiv:1605.09171 [stat.AP]
  (or arXiv:1605.09171v1 [stat.AP] for this version)

Submission history

From: Guillaume Basse [view email]
[v1] Mon, 30 May 2016 10:52:19 GMT (27kb,D)

Link back to: arXiv, form interface, contact.