Byzantine-Robust Distributed Sparse Softmax Regression

arXiv:2611.09110v1 Announce Type: new Abstract: We study Byzantine-robust distributed sparse softmax regression in high-dimensional settings. We propose a communication-efficient distributed algorithm that employs robust aggregation methods---coordinate-wise trimmed mean and coordinate-wise median---to defend against Byzantine attacks. Under sub-Gaussian design assumptions with sparsity constraints, we establish that the distributed estimator achieves the convergence rate of $O_{P}(K^{\frac{5}{2}}\sqrt{s\log(Kd)/N})$ when the Byzantine fraction $\alpha \asymp 1/\sqrt{m}$, matching the centralized oracle rate. Numerical experiments on synthetic data demonstrate the superior performance of the proposed method.