AI & ML
A Function-Space Stability Boundary for Generalization in Interpolating Learning Systems
arXiv stat.ML0 views
arXiv:2602.03514v3 Announce Type: replace-cross Abstract: Modern learning systems often interpolate training data while still generalizing well, yet it remains unclear when algorithmic stability explains this behavior. We model training as a function-space trajectory and measure sensitivity to single-sample perturbations along this trajectory. We propose a contractive propagation condition and a stability certificate obtained by unrolling the resulting recursion. A small certificate implies stability-based generalization, while we also prove that there exist interpolating regimes with small risk where such contractive sensitivity cannot hold, showing that stability is not a universal explanation. Experiments confirm that certificate growth predicts generalization differences across optimizers, step sizes, and dataset perturbations. The framework therefore identifies regimes where stability explains generalization and where alternative mechanisms must account for success.
Source:https://arxiv.org/abs/2602.03514PreviousWho Gets Watched? Allocating Scarce Escalation Resources on Pediatric Wards with Neural Index PoliciesNextSpectral Condition for $\mu$P under Width-Depth Scaling
Related posts

Making Local LLMs Usable on 8GB GPUs
0HackerNoon

Educational Byte: What Are Synthetic Tokens in Crypto Networks?
0HackerNoon
Your AI Assistant Is Waiting Around - An AI Agent Goes to Work
0HackerNoon
Your AI Agent's Memory Needs Two Clocks
0HackerNoon
The Online Right’s Closing Campaign Argument: Fascist Anakin Skywalker Memes
0Wired

Apple is ‘not able to predict’ when it’ll have enough iPhone Duos to go around
0The Verge