AI & ML
Geometry-Dependent Approximation and Stability Properties of Shallow ReLU$^k$ Networks on Bounded Euclidean Domains
arXiv cs.NA0 views
arXiv:2611.13952v1 Announce Type: cross Abstract: On bounded Euclidean domains, we study how hidden-parameter geometry affects shallow ReLU$^k$ networks through results on approximation rates, saturation-type lower bounds, Gram and stiffness matrix spectra, Bernstein and Marcinkiewicz--Zygmund inequalities, discrete least-squares recovery, and inverse approximation. Our analysis uses smooth localization and dyadic Fourier estimates. We quantify parameter geometry by the fill distance $h$ and antipodal separation distance $\underline h$. For the prescribed network space $L_n^k$, representative approximation estimates take the form \begin{equation*} \begin{aligned} \inf_{g_n\in L_n^k}\|f-g_n\|_{\mathcal L^2(\Omega')}&\lesssim h^r\|f\|_{\mathcal H^r(\Omega)},\\ \inf_{g_n\in L_n^k}\|f-g_n\|_{\mathcal L^2(\Omega)}&\gtrsim \underline h^{\frac{d+2k+1}{2}}\|f\|_{\mathcal L^2(\Omega')}. \end{aligned} \end{equation*} The upper bound exploits target regularity up to the critical order $\frac{d+2k+1}{2}$, while the lower bound applies asymptotically to fixed targets smoother than this order. The upper estimate holds on an interior subdomain $\Omega'$, whereas the lower estimate concerns the larger domain $\Omega$. We also obtain geometry-dependent spectral estimates that quantify conditioning and coefficient stability. Further results establish norm discretization and regularized recovery from function values, and infer target regularity from approximation rates under coefficient or separation conditions. Altogether, these results describe how parameter geometry governs approximation accuracy, the stability of coefficient representations, discrete recovery, and the regularity information contained in convergence rates.
Source:https://arxiv.org/abs/2611.13952PreviousLengthscale Estimation for the Gaussian Kernel and Deterministic Response FunctionsNextA Higher Order Local Mesh Method for Approximating 1-Laplacians on Unknown Manifolds
Related posts
Singapore Airlines elevates travel & work with OpenAI technology
0OpenAI Blog
How to Plan a Five-Slide Social Carousel with One Consistent Character
0dev.to

Kimi K2.5 to K3.1 Pro: 8 API Models, One Enterprise Task, and What Actually Got Done
0dev.to
Visa tested 22 shopping agents. 43% failed - and half of those bought anyway. Here's what actually stops it.
0dev.to
Building WUUUH: Skills Drift Faster Than Confidence — Keeping a Hand In During a Career Gap, What Worked, What Broke
0dev.to
FDR-Controlled Variable Selection for Generalized Linear Models and Cox Regression with Virtual Dummies
0arXiv eess.SP