Backend
Self-Normalized Bounds for Time Series with Sample Variance Only and Their Application to Forecasting
arXiv stat.TH0 views
arXiv:2512.01817v5 Announce Type: replace Abstract: Evaluating a forecasting rule on a time series requires a risk bound that can be computed from the observed losses. Such generalization bounds rest on empirical Bernstein (EB) and self-normalized inequalities, which replace the unknown variance by a sample counterpart. These tools, however, have been developed almost exclusively for independent observations and martingale differences, and, for dependent data, the natural setting of forecasting, direct results are scarce. They require $\beta$-mixing and knowledge of the mixing coefficients, and their leading terms are not sharp. This paper fills this gap. We first establish, for martingale differences, an EB inequality in closed form that uses only the realized quadratic variation, holds with probability at least $1-\alpha$ for every sample size, and is sharp under heteroscedasticity, whereas the sharpness of existing EB inequalities is established for a constant conditional variance. Building on this, we derive EB and self-normalized inequalities for the marginal mean of $\tilde{\phi}$- and $\tau$-mixing processes, a class that contains processes that are not even strongly mixing, such as autoregressions with Bernoulli innovations. The radii use nothing but a block sample variance: no variance proxy has to be designed or tuned, and, for $\tau$-mixing processes, no dependence coefficient enters the radius. Under summability-type conditions on the dependence coefficients, their leading terms carry the constant of the oracle Bernstein inequality with the long-run variance, so, to our knowledge, these are the first sharp self-normalized inequalities under non-strong mixing conditions. As an application, we obtain a sharp upper bound on the risk of a time-series forecasting rule that is computed from its observed losses with a single block length and contains no dependence coefficient.
Source:https://arxiv.org/abs/2512.01817PreviousOn Sparsity and Sub-Gaussianity in the Johnson-Lindenstrauss LemmaNextSmoothed estimation of Wasserstein barycenters
Related posts
![Robot Middleware and ROS2 — Ch.06: ROS2 Security [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F3oowmzpb4qkk5km0di1k.png)
Robot Middleware and ROS2 — Ch.06: ROS2 Security [EN]
0dev.to Programming
![Robot Middleware and ROS2 — Ch.07: ROS2 Lifecycle Management [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fx3a51weo0z1ob95yn3x2.png)
Robot Middleware and ROS2 — Ch.07: ROS2 Lifecycle Management [EN]
0dev.to Programming
![Robot Middleware and ROS2 — Ch.08: ROS2 Deployment and DevOps [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F9z4fmoxmqqngiro7boaa.png)
Robot Middleware and ROS2 — Ch.08: ROS2 Deployment and DevOps [EN]
0dev.to Programming
![Robot Middleware and ROS2 — Ch.09: ROS2 for AMR [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fmrvn70kciyfra1s6m77r.png)
Robot Middleware and ROS2 — Ch.09: ROS2 for AMR [EN]
0dev.to Programming
![Robot Middleware and ROS2 — Ch.10: ROS2 for Physical AI [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fboyfq92kdiuwiwz8xsoa.png)
Robot Middleware and ROS2 — Ch.10: ROS2 for Physical AI [EN]
0dev.to Programming
![Robot Middleware and ROS2 — Ch.12: ROS2 Case Studies [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fw7pygqy790h9vw6mz16j.png)
Robot Middleware and ROS2 — Ch.12: ROS2 Case Studies [EN]
0dev.to Programming