AI & ML
Near-Optimal Second-Order Convex Finite-Sum Optimization under Individual Smoothness
arXiv stat.ML0 views
arXiv:2610.42040v1 Announce Type: cross Abstract: We study the stochastic second-order oracle complexity of solving smooth convex finite-sum optimization with $n$ components. Very recently, Tsedenov \& Kovalev (2026) showed that the minimax optimal complexity under averaged smoothness and convexity is $\tilde{\Theta}(n + n^{6/7} \epsilon^{-2/7})$ by establishing nearly matching upper and lower bounds. In this paper, we show that individual smoothness and convexity provably enable further acceleration, where the lower complexity bound is $\Omega(n+ n^{5/7} \epsilon^{-2/7})$ under this stronger assumption. Then, by establishing a novel second-order self-bounding inequality, we design a new Taylor-corrected lazy Newton method, which can lead to a better complexity of $\tilde{\mathcal{O}}(n + n^{5/7} \epsilon^{-2/7})$ by applying the optimal Monteiro-Svaiter acceleration, matching our lower bound up to only logarithmic factors.
Source:https://arxiv.org/abs/2610.42040PreviousChronos-2: A foundation model for multivariate time series forecastingNextCost-Aware Stopping for Freeze-Thaw Bayesian Optimization: When Does One-Step Lookahead Suffice?
Related posts
Australian universities are creating AI-native graduates
0OpenAI Blog

Tính Đóng Gói (Encapsulation) Trong Java Là Gì? Ví Dụ Dễ Hiểu
0dev.to
ISC Stormcast For Friday, November 6th, 2026 https://isc.sans.edu/podcastdetail/10168, (Fri, Nov 6th)
0SANS ISC
Astra did 40% less safety work — OpenAI's own report
0dev.to Discuss

The Facilitator's Stack: A Checklist From Invitation to Follow-Up
0dev.to Productivity
Wabi Not for You? Pick the Right Alternative by What You Actually Need
0dev.to Productivity