General
Simple and Sharp Generalization Bounds via Lifting
arXiv stat.TH0 views
arXiv:2508.18682v5 Announce Type: replace Abstract: We bound the supremum of stochastic processes using a rate-distortion functional analogous to classical entropy integrals. A lifting argument embeds the process into a higher-dimensional space with permutation symmetry, reducing the analysis to a stationary process. This gives a two-sided characterization of the supremum of Gaussian processes, including cases where Dudley's entropy integral is not sharp. Combining the sharpness of Dudley's integral for stationary processes with information-theoretic arguments gives a proof of the majorizing measure theorem. The method also yields localized generalization bounds without a slicing argument. As an application, we derive risk bounds for empirical risk minimization over Lipschitz images of Sobolev ellipsoids. Our proof does not use the majorizing measure theorem.
Source:https://arxiv.org/abs/2508.18682PreviousInstance-dependent sequential limits as an exact information ledgerNextGeneral-purpose post-sampling reweighting method for multimodal target measures
Related posts
An Asymptotic Framework for Closed-Form Estimators from Surrogate Estimating Equations
0arXiv stat.TH
BOXBOX: Recursive Harness Self-Improvement for Long-Running Performance Optimization
0arXiv cs.SE
Graphical Analysis of Lifted Product Code Constructions
0arXiv math.IT
An Efficient Synchronization Scheme for Distributed Bandits
0arXiv math.IT
The Finite Difference Method, for the heat equation on Sierpi\'{n}ski simplices
0arXiv cs.NA
Efficient iterative methods for the nonlinear compressible Reynolds equation with Navier slip boundary condition
0arXiv cs.NA