AI & ML
Lengthscale Estimation for the Gaussian Kernel and Deterministic Response Functions
arXiv cs.NA0 views
arXiv:2611.13930v1 Announce Type: cross Abstract: The uncertainty estimates Gaussian processes output rely on the chosen covariance kernel and its hyperparameters. We study the fixed-domain asymptotics of the maximum likelihood and cross-validation estimators of the lengthscale parameter of the popular infinitely smooth Gaussian kernel when the observations are produced by a fixed univariate response function. No theoretical results for Gaussian lengthscale estimation exist in this setting. We prove lower bounds on the lengthscale estimators that depend on the regularity of the response function, as measured by the rate of decay of its Fourier transform. If the response function lives in the Hilbert space of the Gaussian kernel with lengthscale $\ell$, the lower bounds have a straightforward dependency on $\ell$. For bandlimited functions and functions whose Fourier transforms decay as $\exp(-a \lvert \omega \rvert^\gamma)$ for $a > 0$ and $\gamma > 2$, we prove that the estimators blow up essentially at least as fast as $(\log n)^{(\gamma-2)/(2\gamma)}$ in the number of data points, $n$. Bandlimited functions are identified with $\gamma = \infty$. Unlike analogous results for finitely smooth Mat\'ern kernels, our results make no assumptions on the geometry of the observation points. Numerical experiments illustrate the results.
Source:https://arxiv.org/abs/2611.13930PreviousN -phase flow simulations using X-Mesh and an explicit marker interface representationNextGeometry-Dependent Approximation and Stability Properties of Shallow ReLU$^k$ Networks on Bounded Euclidean Domains
Related posts
I wanted one screen that said whether a kids' app was worth installing
0dev.to

Before I Could Build GPT, I Had to Teach a Machine to Learn
0dev.to
Cogent and OpenAI build cyber defense factories for enterprises
0OpenAI Blog
ChatGPT Plus for veterans and servicemembers
0OpenAI Blog
Hitting 200 Strokes: What the Signature Maker Does at Its Stroke Limit
0dev.to
A Lightweight, Open-Source Network Digital Twin Blueprint for IoT-Edge Environments
0arXiv cs.NI