AI & ML
SEER: A Scalable Event-Driven Runtime for Parallel Execution of Multi-Agent Reinforcement Learning Environments
arXiv cs.DC0 views
arXiv:2611.07996v1 Announce Type: new Abstract: Multi-agent reinforcement learning (MARL) is increasingly used in systems where many entities interact in a shared environment. In these workloads, policy inference can be batched on GPUs, but the CPU-side environment path still updates entity states, resolves local interactions, and builds observations inside each $\mathrm{env.step}$. This path can dominate latency in interaction-intensive workloads after policy batching. Existing vectorized environment interfaces and general event-driven runtimes do not directly address the fine-grained cross-entity work inside one bounded MARL step while preserving the step-level semantics expected by learning systems. We present SEER (Scalable Event-Driven Environment Runtime), a runtime for MARL environment execution under an explicit event-locality contract. SEER models each environment step as a bounded stream of timestamped events. If direct state updates are entity-local and cross-entity effects are represented as ordered future events, SEER can run independent events in parallel while preserving serial-equivalent boundary outputs. To make this contract practical, SEER uses a CAS-based dual-layer event queue: local event queues preserve per-entity causal order, while a parallel executive list exposes ready work to global worker threads. SEER further uses STPA, a preflight-guided thread-pool selection mechanism that combines short runtime traces with static workload and hardware features. We evaluate SEER on two parameterized MARL workloads: compute-intensive UAV swarm control (Aircraft) and communication-intensive wireless management (PCS). On Aircraft, SEER reduces inference latency by 16.2\% over the baseline. On PCS, SEER reduces environment-execution latency by 46.9\%, 19.5\%, and 64.9\% over ROSS-T, NBSE, and ROOT-Sim, respectively.
Source:https://arxiv.org/abs/2611.07996PreviousZeroRAG: Adaptive Semantic Peer Routing for Decentralized Retrieval-Augmented GenerationNextPrecision - Preserving Subtensor Inference for a 22B Joint Audio - Video Generator under a Fixed GPU Working Set
Related posts
Daily briefing: Toothbrush zaps bacteria to clear plaque
0Nature News
The palaeo cave art that hid in plain sight for 26,000 years
0Nature News
PHP 8.6.0 RC5 available for testing
0PHP News
If AI Becomes an Extension of You, What Does That Make It?
0HackerNoon
Meet TwIL-8B, webAI's AI Model for Math, Coding, and Reasoning
0HackerNoon
Aura Autopilot Review: I Tested the AI Game-Testing Agent, and It Found Every Bug
0HackerNoon