AI & ML
Near-Optimal Second-Order Convex Finite-Sum Optimization under Individual Smoothness
arXiv stat.ML0 views
arXiv:2610.42040v1 Announce Type: cross Abstract: We study the stochastic second-order oracle complexity of solving smooth convex finite-sum optimization with $n$ components. Very recently, Tsedenov \& Kovalev (2026) showed that the minimax optimal complexity under averaged smoothness and convexity is $\tilde{\Theta}(n + n^{6/7} \epsilon^{-2/7})$ by establishing nearly matching upper and lower bounds. In this paper, we show that individual smoothness and convexity provably enable further acceleration, where the lower complexity bound is $\Omega(n+ n^{5/7} \epsilon^{-2/7})$ under this stronger assumption. Then, by establishing a novel second-order self-bounding inequality, we design a new Taylor-corrected lazy Newton method, which can lead to a better complexity of $\tilde{\mathcal{O}}(n + n^{5/7} \epsilon^{-2/7})$ by applying the optimal Monteiro-Svaiter acceleration, matching our lower bound up to only logarithmic factors.
Source:https://arxiv.org/abs/2610.42040PreviousChronos-2: A foundation model for multivariate time series forecastingNextCost-Aware Stopping for Freeze-Thaw Bayesian Optimization: When Does One-Step Lookahead Suffice?
Related posts

Berapa banyak memori yang dibutuhkan LLM lokal?
0dev.to
Run Your WordPress Site From ChatGPT or Claude — Free Until 30 November 2026
0dev.to
Codex MCP: add, configure and debug MCP servers in Codex CLI
0dev.to
Statehouse wins give Democrats new power to push clean energy
0Ars Technica
Is MAHA dying—or will it be reborn? What's next after crushing midterm losses?
0Ars Technica

Muse has a voice mode now
0The Verge