AI & ML
Worst-Case Discovery and Runtime Protection for RL-Based Network Controllers
arXiv eess.SY0 views
arXiv:2605.04373v2 Announce Type: replace-cross Abstract: RL-based controllers achieve strong average-case performance in networking tasks such as congestion control and adaptive bitrate streaming. Yet their performance can degrade severely under network conditions where strong performance is still achievable. Identifying such conditions and quantifying the resulting performance gap is intractable by enumeration, while the sequential and closed-loop nature of RL controllers makes formal verification methods impractical. We present ReGuard, a framework that discovers worst-case scenarios for a given RL controller and protects it against them at inference time without retraining. ReGuard formulates scenario discovery as a bilevel regret-maximization problem, certifying a lower bound on the controller's worst-case performance gap. ReGuard then analyzes the discovered counterfactual trajectories and compiles them into lightweight logic rules that intervene only when a risky state is detected, leaving the controller's behavior unchanged otherwise. We evaluate ReGuard across three RL-based network controllers: Pensieve, Sage, and Park. ReGuard discovers scenarios in which each controller suffers a 43-64% performance loss relative to what is achievable under the same conditions. ReGuard exposes performance gaps 57% to 6 times larger than those found by the strongest baselines and shrinks those gaps by 79-85% in its first iteration via lightweight rule-based protection, iteratively driving the remaining gap toward nominal levels. ReGuard's protection extends beyond the scenarios it discovers, improving performance across a wide range of network conditions.
Source:https://arxiv.org/abs/2605.04373PreviousDirection-Dependent Path Loss Modeling in Olive Orchards for Precision AgricultureNextThermoLLM: LLM-Based Multi-Zone HVAC Control with a Spatiotemporal Context
Related posts

Amazon will let you text Alexa your shopping list
0The Verge

TikTok’s For You page needs to change, says the EU
0The Verge

Stranger Things is getting a live-action spinoff called Other Worlds
0The Verge
The Cost of Self-Hosting Open-Source LLMs: GPUs, Staffing, and Operations
0dev.to
The central challenge of working with AI
0dev.to
Where an e-commerce explainer video belongs, and what to show in it
0dev.to