AI & ML
Training-point consistency of kernel ridge regression with varying correlation scales
arXiv stat.ML0 views
arXiv:2611.18095v1 Announce Type: new Abstract: The scale parameter in kernel ridge regression plays a pivotal role in modeling the correlation structure of data. In modern applications, sampling density and the underlying correlation range often change simultaneously, making a fixed-scale assumption highly restrictive. However, establishing asymptotic theories under varying scale parameters is fundamentally challenging. To address this gap, this paper develops a unified theoretical framework for kernel ridge regression under varying scale parameters. We establish that, on uniform tensor grids with product exponential kernels, the consistency of the training-point risk holds if and only if the effective local sample size diverges to infinity. This sharp criterion universally covers all regimes along arbitrary deterministic scale sequences, seamlessly unifying the long-range, fixed-scale, and short-range. Furthermore, we provide an explicit, signal-independent construction of a deterministic regularization penalty that guarantees this consistency. Numerical experiments illustrate the criterion and the corresponding penalty across all the three regimes.
Source:https://arxiv.org/abs/2611.18095PreviousEfficient and Practical Clustering of Variables in Causal GraphsNextDetection and Classification in Latent Spaces: High-Dimensional Analysis and Validation
Related posts
The King’s Trust and OpenAI launch £1m partnership
0OpenAI Blog

AI Skills and the Gender Gap: Who Gets Ahead in the Changing Job Market?
0HackerNoon

AI in Leadership: Managing People, Not Just Work
0HackerNoon
Neuroscience: What is Human Intelligence in the Brain?
0HackerNoon
How to Prevent Silent Failures in Multi-Agent AI Systems
0HackerNoon
I Created an AI Cat That Thinks for Herself. Now I Have More Questions Than Answers
0HackerNoon