AI & ML
Training-point consistency of kernel ridge regression with varying correlation scales
arXiv stat.ML0 views
arXiv:2611.18095v1 Announce Type: new Abstract: The scale parameter in kernel ridge regression plays a pivotal role in modeling the correlation structure of data. In modern applications, sampling density and the underlying correlation range often change simultaneously, making a fixed-scale assumption highly restrictive. However, establishing asymptotic theories under varying scale parameters is fundamentally challenging. To address this gap, this paper develops a unified theoretical framework for kernel ridge regression under varying scale parameters. We establish that, on uniform tensor grids with product exponential kernels, the consistency of the training-point risk holds if and only if the effective local sample size diverges to infinity. This sharp criterion universally covers all regimes along arbitrary deterministic scale sequences, seamlessly unifying the long-range, fixed-scale, and short-range. Furthermore, we provide an explicit, signal-independent construction of a deterministic regularization penalty that guarantees this consistency. Numerical experiments illustrate the criterion and the corresponding penalty across all the three regimes.
Source:https://arxiv.org/abs/2611.18095PreviousEfficient and Practical Clustering of Variables in Causal GraphsNextDetection and Classification in Latent Spaces: High-Dimensional Analysis and Validation
Related posts
Syncing dual-system audio across multiple cameras without timecode, then letting an AI rough-cut it via MCP
0dev.to
Why LLMs Hallucinate on PDF Extraction and How Grounded Extraction Makes It Verifiable
0dev.to
Doing Show HN generates a ton of automated email pitches
0Hacker News
Apple TV App to Get Video Podcasts Section Today
0MacRumors

New Apple TV 4K's A19 Chip Has One Core Switched Off
0MacRumors
How the brain decides which moments to remember – and which to forget
0Hacker News New