Backend
Norm-equation methods for structured group-penalized regression
arXiv stat.CO0 views
arXiv:2611.25668v1 Announce Type: new Abstract: Group-penalized regression with correlated predictors requires block updates for which familiar group soft thresholding formulas are generally inapplicable. Although proximal-gradient methods can solve such updates directly, their computational cost depends on the penalty and the design. We develop a norm-equation framework for a Euclidean group penalty combined with a finite, closed, convex, positively homogeneous within-group penalty. Each nonzero block minimizer is characterized by a unique scalar root, evaluated through strongly convex inner problems without enumerating sparsity or fusion patterns. Valid inner subgradients provide computable bounds on the scalar function and the block Karush-Kuhn-Tucker (KKT) error. These bounds allow scalar-search decisions and acceptance of approximate updates without solving every inner problem to high accuracy. Accounting for gradient changes during a cyclic sweep then gives a computable global KKT bound. Combined with standard stochastic-score and restricted-curvature conditions, this bound leads to a regularization-scaled stopping rule under which approximate estimators retain the usual estimation and prediction rates. Experiments with sparse-group and fused sparse-group regression show that computational performance depends strongly on the inner solver, with coordinate-descent and dual implementations offering advantages over direct proximal methods in some highly correlated settings.
Source:https://arxiv.org/abs/2611.25668PreviousISC Stormcast For Friday, November 20th, 2026 https://isc.sans.edu/podcastdetail/10188, (Fri, Nov 20th)NextFast and Memory-Light Evaluation of Density-Based Clusterings with the DISCO Index in R
Related posts

PostgreSQL 19 removes the MultiXact members wall. Reclamation still waits for template0.
0dev.to
Hugging Face Breach: Security Lessons for AI Agents
0dev.to
Incus Project and Migration Trust Boundaries Need Separate Review
0dev.to

Next.js `revalidatePath` vs `revalidateTag` in 2026: Choosing the Right Cache Invalidation Primitive at Scale
0dev.to

'python' Is Not Recognized as an Internal or External Command: Every Fix
0dev.to

Xcode Instruments in Practice: Profiling and Optimizing iOS Apps
0dev.to