We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: A New Framework for Online Testing of Heterogeneous Treatment Effect

Abstract: We propose a new framework for online testing of heterogeneous treatment effects. The proposed test, named sequential score test (SST), is able to control type I error under continuous monitoring and detect multi-dimensional heterogeneous treatment effects. We provide an online p-value calculation for SST, making it convenient for continuous monitoring, and extend our tests to online multiple testing settings by controlling the false discovery rate. We examine the empirical performance of the proposed tests and compare them with a state-of-art online test, named mSPRT using simulations and a real data. The results show that our proposed test controls type I error at any time, has higher detection power and allows quick inference on online A/B testing.
Comments: 8 pages, no figures. To be published on AAAI 2020 proceedings
Subjects: Methodology (stat.ME); Applications (stat.AP)
Cite as: arXiv:2002.03277 [stat.ME]
  (or arXiv:2002.03277v1 [stat.ME] for this version)

Submission history

From: Miao Yu [view email]
[v1] Sun, 9 Feb 2020 04:02:11 GMT (28kb)

Link back to: arXiv, form interface, contact.