AI & ML
Regret-Optimal Wasserstein-Robust Linear Regression
arXiv stat.ML0 views
arXiv:2610.42109v1 Announce Type: new Abstract: Distributionally robust optimization (DRO) minimizes worst-case risk under distributional uncertainty, but its decisions can be suboptimal in terms of their excess risk, or regret. We study this gap for multivariate least-squares regression, assuming that the observed source law and unknown target law differ by an adversarial 2-Wasserstein perturbation of size $\varepsilon$. We first identify the asymptotic complexity of robust decision-making in the $\varepsilon \to 0$ limit, characterized by a problem-specific condition number $\kappa$. Here, a wide spectrum of simple algorithms, including DRO, achieve the instance-optimal rate of $O(\kappa \varepsilon^2)$. For fixed $\varepsilon > 0$, we prove that DRO still achieves the minimax rate if the problem has bounded residual effective rank. On the other hand, we identify significant failure modes where DRO is provably suboptimal by dimension-dependent factors. Fortunately, we prove that two alternative procedures, minimax regret optimization (MRO) and spectral-norm regularization (SNR), attain the minimax rate. We derive an exact convex reformulation of MRO and an accelerated proximal algorithm for SNR, along with high-probability finite-sample guarantees. We support these theoretical results with numerical experiments separating the performance of MRO and SNR from DRO.
Source:https://arxiv.org/abs/2610.42109PreviousWASABI: Wasserstein Sampling via Bridge InterpolantsNextDual-Corrected Stochastic Block Model ($\text{DC}^2\text{SBM}$): A Generalized Structure Detection Method for Attributed Networks
Related posts

Stop Writing the Perfect Prompt. Claude Code's Docs Say Let It Interview You
0dev.to AI
$2 Trillion to $1.5 Trillion: How the 2026 Midterms Turned Anthropic’s IPO Into a Stress Test
0dev.to AI
ViKernel's Action-Permission Boundary: What VIDRAFT's 661-Run Internal Test Actually Tells Engineers
0dev.to AI
Hydra · Coeziune OM–IA v13: new DOI and the complete DOI registry (2026-11-06)
0dev.to AI
Merge PDF Pages in the Browser: Reorder, Rotate and Export Without Uploading
0dev.to WebDev
Tech trends, week of Nov 6, 2026: AI security research, audit skills, Images 2.6
0dev.to Security