We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Accurate Inference for Adaptive Linear Models

Abstract: Estimators computed from adaptively collected data do not behave like their non-adaptive brethren. Rather, the sequential dependence of the collection policy can lead to severe distributional biases that persist even in the infinite data limit. We develop a general method -- $\mathbf{W}$-decorrelation -- for transforming the bias of adaptive linear regression estimators into variance. The method uses only coarse-grained information about the data collection policy and does not need access to propensity scores or exact knowledge of the policy. We bound the finite-sample bias and variance of the $\mathbf{W}$-estimator and develop asymptotically correct confidence intervals based on a novel martingale central limit theorem. We then demonstrate the empirical benefits of the generic $\mathbf{W}$-decorrelation procedure in two different adaptive data settings: the multi-armed bandit and the autoregressive time series.
Comments: Typos fixed for clarification
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
Cite as: arXiv:1712.06695 [stat.ML]
  (or arXiv:1712.06695v5 [stat.ML] for this version)

Submission history

From: Yash Deshpande [view email]
[v1] Mon, 18 Dec 2017 22:07:29 GMT (723kb,D)
[v2] Wed, 20 Jun 2018 21:30:24 GMT (759kb,D)
[v3] Wed, 14 Aug 2019 14:11:49 GMT (1242kb,D)
[v4] Thu, 5 Sep 2019 20:04:37 GMT (1219kb,D)
[v5] Thu, 2 Jan 2020 22:33:42 GMT (1219kb,D)

Link back to: arXiv, form interface, contact.