AI & ML
Cost-Aware Stopping for Freeze-Thaw Bayesian Optimization: When Does One-Step Lookahead Suffice?
arXiv stat.ML0 views
arXiv:2610.42085v1 Announce Type: cross Abstract: Freeze-thaw Bayesian optimization (BO) evaluates candidates in resumable increments but usually stops at a budget or convergence test. We maximize a budget-free utility, the best observed score minus a cost per increment, with a one-step lookahead: advance the candidate with the largest expected improvement (EI) under a fixed surrogate, and stop once no EI exceeds the cost. This rule, EI stopping, never falls below stopping immediately in expected utility, yet it can stop too early. We construct a certificate, a lower bound on the value of two-step lookahead, that proves such a stop premature, and repeating this correction never lowers expected utility under the surrogate. Under the surrogate, EI stops are premature on average at low costs and lose little at high costs. On three hyperparameter optimization benchmarks, a pre-registered test finds EI stopping noninferior to the correction in most high-cost settings, while the correction gains at low costs on two of the three; more information sharing in the surrogate raises EI stopping's utility. On the surrogates of two published methods, EI stopping trades lower scores for fewer training increments. EI stopping is a simple cost-aware reference whose utility depends on the surrogate.
Source:https://arxiv.org/abs/2610.42085PreviousNear-Optimal Second-Order Convex Finite-Sum Optimization under Individual SmoothnessNextCausalWAM: Learning the Causes of Actions in World Action Models
Related posts

Quantization, Explained: From FP32 to INT4, and What Each Precision Costs You
0dev.to AI
Black Friday hosting: how to tell a real deal from a fake one
0dev.to WebDev

The Nasdaq 100 drops 6%, losing a record $2.3T in value, and the Philadelphia chip index plunges 12%, on concerns over the AI trade after Democrats won Congress (Natalia Kniazhevich/Bloomberg)
0Techmeme

Apple's New HomeView Smart Home Hub: Here's How Much RAM It Has
0MacRumors
Rewind on an Older Apple Watch: Memova's Upcoming Feature
0Hacker News New
Plain Vanilla Web
0Hacker News New