General
Simple and Sharp Generalization Bounds via Lifting
arXiv stat.TH0 views
arXiv:2508.18682v5 Announce Type: replace Abstract: We bound the supremum of stochastic processes using a rate-distortion functional analogous to classical entropy integrals. A lifting argument embeds the process into a higher-dimensional space with permutation symmetry, reducing the analysis to a stationary process. This gives a two-sided characterization of the supremum of Gaussian processes, including cases where Dudley's entropy integral is not sharp. Combining the sharpness of Dudley's integral for stationary processes with information-theoretic arguments gives a proof of the majorizing measure theorem. The method also yields localized generalization bounds without a slicing argument. As an application, we derive risk bounds for empirical risk minimization over Lipschitz images of Sobolev ellipsoids. Our proof does not use the majorizing measure theorem.
Source:https://arxiv.org/abs/2508.18682PreviousInstance-dependent sequential limits as an exact information ledgerNextGeneral-purpose post-sampling reweighting method for multimodal target measures
Related posts
Digital Presenteeism as a Stratified Signalling System [pdf]
0Hacker News New
Reconfigurable Photonic Integrated Circuits in Glass, Femtosecond Laser Writing [pdf]
0Hacker News New
Amp is the best thing since sliced bread
0Hacker News New
BYD's electric hypercar hits 312 MPH, first production car over 500 km/h
0Hacker News New
The message format that was already in ASCII
0Hacker News New
Fourteen MB Hinglish STT pWER 29, stary words 2.3/100
0Hacker News New