AI & ML
Near-Optimal First-Order Regret for Bandits with Feedback Graphs
arXiv stat.ML0 views
arXiv:2610.40861v1 Announce Type: cross Abstract: We study first-order regret guarantees for adversarial bandits with a fixed, known directed feedback graph. For strongly observable graphs, [ACBDK15] establishes a minimax regret of $\widetilde{\Theta}(\sqrt{\alpha T})$, where $\alpha$ denotes the independence number of the graph and $T$ denotes the horizon. On the other hand, the best existing first-order bound scales as $\widetilde{O}(\sqrt{(\kappa+1) L^\star})$ [LLZ20], where $\kappa$ denotes the clique partition number, satisfying $\kappa+1\geq\alpha$, and $L^\star$ denotes the cumulative loss of the best arm, leaving a gap between the graph dependence in worst-case and first-order guarantees. In this paper, we bridge this gap by obtaining an expected regret bound of $\widetilde{O}(\sqrt{\alpha L^\star}+\alpha)$. Our first result is an algorithm for the special case of self-aware graphs, in which every vertex has a self-loop. The algorithm combines the update of EXP3 [ACBFS02] with a sampling rule inspired by exploration by optimization [LS20]. More specifically, we construct a map whose fixed points yield sampling distributions that control the one-round regret remainder in terms of the learner's loss and the graph's independence number, which is crucial in deriving optimal first-order guarantees. We further show that a sufficiently accurate fixed point can be computed in polynomial time by a geometrically convergent iteration. Finally, we extend the algorithm to general strongly observable graphs and achieve the same $\widetilde{O}(\sqrt{\alpha L^\star}+\alpha)$ guarantee by adapting the two-level aggregation approach of [LLZ20].
Source:https://arxiv.org/abs/2610.40861PreviousCertified Behavioral Retention for Continual Adaptation with Held-Out AnchorsNextDensity-Guided Bootstrap Boundaries for Latent World-Model Reinforcement Learning
Related posts
Merge builds product and business tools with OpenAI technology
0OpenAI Blog
How to Survive (Not Thrive) as a Salaryman
0HackerNoon
Debugging macOS LaunchAgent Failures With launchctl and Exit Code 78
0HackerNoon

Building Data Observability for Banking Pipelines
0HackerNoon
OpenMatter Network Positions Decentralized Computing as an Alternative To Data Centers for AI
0HackerNoon
BMW bumps battery for the better: The 2027 i7 60 xDrive, driven
0Ars Technica