AI & ML
Locally Linear Generalized Single Index Regression
arXiv stat.ML0 views
arXiv:2611.22011v1 Announce Type: cross Abstract: In this work we propose and analyze a procedure for estimating a generalized single-index regression model. This generalized single-index regression framework models the conditional mean of the responses $Y$ as a function of the covariates $X$ where the mapping is assumed to have the form $f \circ g$, where $g$ is $\beta$-H\"older with $\beta \geq 2$ and $f$ can be a discontinuous function of bounded variation. We propose a general procedure that operates under minimal assumptions about the distribution of covariates $X$, requiring only boundedness, sufficient smoothness and absolute continuity with respect to Lebesgue. Our procedure jointly estimates the gradient vector $\hat v(x) \approx \nabla g(x)$ and the conditional mean $\mu(x) = f(g(x))$ by solving a localized weighted linear least squares problem. We derive central limit theorems for gradient vector estimates $\hat{v}_x$ and regression estimates $\hat{\mu}(x)$, and we derive rates of convergence for our approach, illustrating that it indeed achieves a stochastic convergence rate matching the minimax mean squared error rate when $\beta = 2$ and $f$ has a locally Lipschitz derivative. Unlike prior approaches our velocity estimation results accommodate link functions in the local bounded-variation class, allowing for nonsmooth and even discontinuous links while retaining consistency and asymptotic normality at almost every inference point. Finally, we instantiate this model in the situation where $g = \Pi$ is a closest point projection onto a compact and regular embedded $C^3$ curve $\gamma$, a setting recently studied in the literature. We also supplement our theoretical results with experiments on real and synthetic data to demonstrate the utility of our procedure.
Source:https://arxiv.org/abs/2611.22011PreviousDEFTS: Data-Efficient, Training-Free Few-Shot Learning for CLIP in the Text SubspaceNextTwo Counterexamples for e-means
Related posts
Closest relatives of poxviruses prevail in human and animal guts worldwide
0Nature News

Apple Creator Studio adds MotionVFX for Final Cut Pro, new Pixelmator Pro features, more
09to5Mac
Media Mogul Omri Hurwitz Launches 'Live from Tel Aviv Stock Exchange' TV Show for Bay Area Audiences
0HackerNoon
How Cash Withdrawal Limits, CTRs, and Anti-Money Laundering Rules Work
0HackerNoon
AI Adoption Maturity Matrix (AAMM): The 5 Levels Every Organization Goes Through
0HackerNoon

The HackerNoon Newsletter: Is AI Really Creating New Jobs? Data From 12 Countries Suggests Otherwise (11/18/2026)
0HackerNoon