AI & ML
On the Validity of Fisher Randomization Tests under the Weak Null
arXiv stat.TH0 views
arXiv:2611.24821v1 Announce Type: cross Abstract: Consider the problem of testing the Neyman weak null of no sample average treatment effect $H_{0N}:\tau = 0$ in randomized experiments with binary outcomes. Although the Fisher Randomization Test (FRT) is typically justified under Fisher's sharp null of no individual treatment effect, we show that it is finite-sample-valid for the weak null $H_{0N}$ in three common combinations of study design and test statistic: 1) balanced completely randomized experiments with the difference-in-means test statistic, 2) matched pairs experiments with the same test statistic, and 3) balanced Bernoulli randomized experiments with the centered Horvitz-Thompson test statistic. As an immediate corollary, Fisher's exact test in a balanced completely randomized experiment is valid under the weak null, and so is McNemar's test in a matched pairs experiment. Similar results hold for the one-sided null $H_0:\tau \leq 0$. Beyond balanced designs, we show that twice the one-sided FRT $p$-value with the same test statistics is valid under $H_{0N}$. In simulation experiments, the FRTs compare favorably to other exact procedures.
Source:https://arxiv.org/abs/2611.24821PreviousAnytime-valid goodness-of-fit test by $e$-spacingsNextAssessing model calibration with boosting trees
Related posts
20x longer: Google's 'temporary' AI chats last 2 months
0dev.to Discuss
How I stopped guessing: confused about whether to submit a bid or a proposal and
0dev.to Discuss
Scalenut Review: Features, Pricing, Pros, Cons, and Alternatives
0dev.to Productivity
Xelta AI: The All-in-One AI Creative Platform Transforming How Content Is Created
0dev.to Productivity
How to Make AI Writing Sound More Human: A Guide to Authentic Content Creation
0dev.to Productivity
Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesis
0arXiv eess.IV