General
Simple and Sharp Generalization Bounds via Lifting
arXiv stat.TH0 views
arXiv:2508.18682v5 Announce Type: replace Abstract: We bound the supremum of stochastic processes using a rate-distortion functional analogous to classical entropy integrals. A lifting argument embeds the process into a higher-dimensional space with permutation symmetry, reducing the analysis to a stationary process. This gives a two-sided characterization of the supremum of Gaussian processes, including cases where Dudley's entropy integral is not sharp. Combining the sharpness of Dudley's integral for stationary processes with information-theoretic arguments gives a proof of the majorizing measure theorem. The method also yields localized generalization bounds without a slicing argument. As an application, we derive risk bounds for empirical risk minimization over Lipschitz images of Sobolev ellipsoids. Our proof does not use the majorizing measure theorem.
Source:https://arxiv.org/abs/2508.18682PreviousInstance-dependent sequential limits as an exact information ledgerNextGeneral-purpose post-sampling reweighting method for multimodal target measures
Related posts
Show HN: CodeHub – Turning release notes into pictures so that it is fun to read
0Hacker News New
'A new age of climate extremes': Earth accumulating heat at accelerating rate
0Hacker News New
Stop Measuring Developer Productivity
0Hacker News New
Ask HN: Will Humans Become Useless?
0Hacker News New
Stock market casino: the rising stakes of 'gamified' investing
0Hacker News New
Show HN: A 40MB TTS model hand-ported to run in the browser (TS and WGSL)
0Hacker News New