AI & ML
Nonparametric Regression on Fixed-Cardinality Subsets:Minimax Risk and Random-Design Effects
arXiv stat.TH0 views
arXiv:2609.15592v2 Announce Type: replace Abstract: We study regression from noisy evaluations of uniformly sampled subsets containing exactly \(k\) items from a ground set of size \(d\), a setting motivated by combination screening. The fixed-cardinality constraint couples membership coordinates and prevents a direct use of product-domain notions of interaction and smoothness. Using the harmonic decomposition of the Johnson graph, we define an intrinsic Johnson--Sobolev scale and determine the exact dimensions of low-order interaction spaces. We establish finite-sample risk bounds for harmonic projection and a nonasymptotic minimax characterization when the Sobolev energy budget is bounded relative to the noise variance proxy. We also study sparsity when responses depend on few items, quantifying the reduced interaction dimension and the effects of unknown support and rare configurations. When the empirical Gram matrix is well conditioned, stable least squares removes the design fluctuation of the component already in the fitted space. A rank-deficiency analysis identifies the components left unresolved by random sampling. Combined with a centered completion estimator, it yields minimax bounds matching up to constants whenever \(\min(k,d-k)\) and the smoothness order are fixed, without restricting the signal-to-noise ratio. Numerical experiments distinguish observation noise, design fluctuation, and incomplete coverage; NCI-ALMANAC drug-pair scores provide a real-data illustration.
Source:https://arxiv.org/abs/2609.15592PreviousAssessing model calibration with boosting treesNextSemiparametric Efficient Inference under Non-Informative Complex Survey Designs
Related posts
LIC-Audit: How Comparable Are Reported Gains in Learned Image Compression?
0arXiv eess.IV
Streaming Generative Video Compression with Embedding Alignment and In-Context Propagation
0arXiv eess.IV
Beyond Accuracy: Benchmarking Uncertainty Quantification in Retinal Disease Screening
0arXiv eess.IV
CiGS: Conduction in Gaussian Splats for Interior Temperature Field from Thermal Images
0arXiv cs.GR
Probing Physics in Motion Diffusion Models Against Their Own Estimate
0arXiv cs.GR
NIRJALA: Draining the Sea out of Gaussian Splatting with Three-Path Optics and Reversible Physics
0arXiv cs.GR