Backend
Addressing Exogenous Variability in Cooperative Multi-Agent Reinforcement Learning
arXiv cs.MA0 views
arXiv:2611.22067v1 Announce Type: new Abstract: Cooperative multi-agent reinforcement learning (MARL) often fails under exogenous variability such as shifts in opponents or environment regimes that cannot be controlled by the team but alter the transition dynamics. We formalize this challenge as Exogenous Dec-POMDP (ED-POMDP), in which an episode-level exogenous regime, selected independently of the team, indexes the dynamics, and the global state is partitioned into components that are directly responsive to the current team action and components that are not directly action-responsive at the current step. This formulation exposes mediated influence: while team actions do not directly update the latter at the current step, they can shape their later evolution through induced changes in the former. Based on this, we propose LEICA, a CTDE-compatible algorithm that learns history-conditioned context representations for both components and shapes policy updates using agent-wise, influence-weighted counterfactual intrinsic rewards. Across SMAX benchmarks with opponent strategy shifts, LEICA consistently improves both training performance and generalization to unseen opponents' strategies over existing baselines, supporting the usefulness of influence-weighted shaping under exogenous train-test regime shifts.
Source:https://arxiv.org/abs/2611.22067PreviousCoordination of Heterogeneous Teams with Uncertain Task RequirementsNextEmergence and Collapse of Leader-Follower Flocks through Phantom Targets: Surprise Nullification in Bayesian and Inverse Bayesian Inference
Related posts

The Claim Row Stopped the Duplicate. My Agent Sent the Payment Twice Anyway.
0dev.to Database

SeaweedFS 4.54: S3 Storage, Iceberg Tables and Vector Buckets
0dev.to Database
Where Is the Cost of Third-Party API Routers in Agentic Software Development?
0arXiv cs.SE
RyBench: Runtime Verification Benchmarking Framework over Publish/Subscribe Networks
0arXiv cs.SE
When the World Is the Test Suite: Agentic Intelligence for the Physical World
0arXiv cs.SE
Direct Numerical Simulation of Thermoacoustically Unstable Flames Via Non-Drifting Acoustic Delay Characteristic Boundary Conditions
0arXiv cs.NA