Backend
Optimal distribution-free sequential change detection with conformal martingales
arXiv stat.TH0 views
arXiv:2609.27179v2 Announce Type: replace Abstract: We study the challenging problem of distribution-free sequential changepoint detection for independent observations with unknown and \emph{completely unrestricted} pre- and post-change laws. For over two decades, the primary existing solution for this problem has employed Vovk's conformal test martingales and associated e-detectors, which control the probability of false alarm (PFA) and the average run length (ARL) respectively. The majority of these works focus on validity, with statistical efficiency usually left for simulations. We develop a comprehensive theory of how conformal p-values behave under non-exchangeable data with a changepoint at an unknown time $T$. We use this to analyze the post-change growth and resulting detection delays and find that the standard existing methods are provably suboptimal for PFA and ARL control, and can lead to delays that are $\Omega(T)$ and $\Omega(\sqrt{\text{ARL}})$ respectively. We construct new conformal e-processes and e-detectors with learned scores and a fixed, distribution-independent betting dictionary. For any distribution pair with positive finite KL divergence, our methods asymptotically achieve $\log T/\mathrm{KL}$ delay for PFA control and $\log\mathrm{ARL}/\mathrm{KL}$ delay (with a sharp leading constant of 1), which are both proven to be minimax optimal in a suitable double-array framework. Simulations illustrate the large empirical benefits of our new approach.
Source:https://arxiv.org/abs/2609.27179PreviousSigmoid-FTRL: Design-Based Adaptive Neyman Allocation for AIPW EstimatorsNextBayesian Nonparametric Global-local Clustering of High-dimensional Functions
Related posts
Whiel: A Neurosymbolic Platform for Certified Relational Program Verification
0arXiv cs.DB
GTI-mSEMP Framework : A Proposed Framework to Simulate Malware Propagation with Inclusion of Attacker-Defender Strategy
0arXiv cs.NI
When Does Risk-Controlled Throughput Forecasting Actually Control Risk? A Reproduction Study on LEO Satellite Link
0arXiv cs.NI
Mobility-Aware Mobile Edge Computing for Energy-Balanced Data Collection in IoT-Enabled Underwater Sensor Networks
0arXiv cs.NI
Coexistence-Aware Antenna Tilt and Resource Allocation for Cellular-Connected UAV Corridors
0arXiv cs.NI
StarWorld: A Cross-Layer World Model for Starlink Prediction and Streaming
0arXiv cs.NI