AI & ML
Near-Optimal Sample Complexity of Deterministic Agnostic PAC Learning
arXiv stat.ML0 views
arXiv:2611.13210v1 Announce Type: new Abstract: We study the problem of agnostic PAC learning under deterministic labels, where the examples are labeled by an arbitrary deterministic function, which need not belong to the concept class $C$. This model captures misspecification without stochastic label noise and lies between the realizable and fully agnostic settings. Prior work showed that, when $C$ has finite diameter $K$ and VC dimension $d$, deterministic labels can improve the sample complexity upper bound from the classical agnostic guarantee $O(d/\varepsilon^2)$ to $\widetilde{O}(K/\varepsilon)$, but left a large gap between upper and lower bounds. Our main result sharpens this picture. We prove that every class of VC dimension $d$ and finite diameter $K$ is learnable with sample complexity $\widetilde{O}\left( \frac{K^{1/3} \, d^{2/3}}{\varepsilon} \right)$, and we construct classes for which this bound is tight up to logarithmic factors. We also study the online analogue of this problem and show that the minimax regret is again partly controlled by the diameter of the class. Technically, our upper bounds are obtained via memorization-based learning algorithms that exploit the deterministic label structure.
Source:https://arxiv.org/abs/2611.13210PreviousLocation Matters: Sparse Latent-Variance Attacks for Face Privacy against Diffusion PersonalizationNextMediPFN: Amortized In-Context Nuisance Learning and Inference for Causal Mediation Analysis
Related posts
Singapore Airlines elevates travel & work with OpenAI technology
0OpenAI Blog
How to Plan a Five-Slide Social Carousel with One Consistent Character
0dev.to

Kimi K2.5 to K3.1 Pro: 8 API Models, One Enterprise Task, and What Actually Got Done
0dev.to
Visa tested 22 shopping agents. 43% failed - and half of those bought anyway. Here's what actually stops it.
0dev.to
Building WUUUH: Skills Drift Faster Than Confidence — Keeping a Hand In During a Career Gap, What Worked, What Broke
0dev.to
FDR-Controlled Variable Selection for Generalized Linear Models and Cox Regression with Virtual Dummies
0arXiv eess.SP