Abstract:Adaptive experiments use preliminary analyses of the data to inform further course of action and are commonly used in many disciplines including medical and social sciences. Because the null hypothesis and experimental design are data-dependent, it has long been recognized that statistical inference for adaptive experiments is not straightforward. Most existing methods only apply to specific adaptive designs and rely on strong assumptions. In this work, we propose selective randomization inference as a general framework for analysing adaptive experiments. In a nutshell, our approach applies conditional post-selection inference to randomization tests. By using directed acyclic graphs to describe the data generating process, we derive a selective randomization p-value that controls the selective type-I error. As inference only relies on the randomness in the treatment assignment, no modelling assumptions or independent and identically distributed data are needed. We elaborate on conditions that render the proposed p-value computable and provide rejection sampling and MCMC algorithms to find a Monte Carlo approximation. Moreover, this article shows how to estimate and construct confidence intervals for a homogeneous treatment effect. Lastly, we demonstrate our method and compare it with other randomization tests using synthetic and real-world data.
| Subjects: | Methodology (stat.ME) |
| Cite as: | arXiv:2405.07026 [stat.ME] |
| (or arXiv:2405.07026v4 [stat.ME] for this version) | |
| https://doi.org/10.48550/arXiv.2405.07026 arXiv-issued DOI via DataCite |
From: Qingyuan Zhao [view email]
[v1]
Sat, 11 May 2024 14:56:27 UTC (1,159 KB)
[v2]
Sat, 26 Oct 2024 22:59:19 UTC (1,263 KB)
[v3]
Wed, 10 Sep 2025 20:02:28 UTC (1,168 KB)
[v4]
Fri, 22 May 2026 18:51:47 UTC (1,150 KB)
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。