Backend
Addressing Exogenous Variability in Cooperative Multi-Agent Reinforcement Learning
arXiv cs.MA0 views
arXiv:2611.22067v1 Announce Type: new Abstract: Cooperative multi-agent reinforcement learning (MARL) often fails under exogenous variability such as shifts in opponents or environment regimes that cannot be controlled by the team but alter the transition dynamics. We formalize this challenge as Exogenous Dec-POMDP (ED-POMDP), in which an episode-level exogenous regime, selected independently of the team, indexes the dynamics, and the global state is partitioned into components that are directly responsive to the current team action and components that are not directly action-responsive at the current step. This formulation exposes mediated influence: while team actions do not directly update the latter at the current step, they can shape their later evolution through induced changes in the former. Based on this, we propose LEICA, a CTDE-compatible algorithm that learns history-conditioned context representations for both components and shapes policy updates using agent-wise, influence-weighted counterfactual intrinsic rewards. Across SMAX benchmarks with opponent strategy shifts, LEICA consistently improves both training performance and generalization to unseen opponents' strategies over existing baselines, supporting the usefulness of influence-weighted shaping under exogenous train-test regime shifts.
Source:https://arxiv.org/abs/2611.22067PreviousCoordination of Heterogeneous Teams with Uncertain Task RequirementsNextEmergence and Collapse of Leader-Follower Flocks through Phantom Targets: Surprise Nullification in Bayesian and Inverse Bayesian Inference
Related posts
Signature Webhook HMAC-SHA256 Tidak Cocok? Hex vs Base64 dan 4 Jebakan yang Sering Terjadi
0dev.to
How do I make sure my agent drops outdated instructions instead of getting confused?
0dev.to

Klastro Walkthrough: Real Kubernetes Labs, in Your Browser
0dev.to
Part 2: The Main Problem - My Kali Download Was Too Small
0dev.to

Where the human gate goes: designing autonomy for coding agents
0dev.to
Nine clocks in one Next.js app, and the copyright year on 109 of our 111 pages was decided at 18:52 on 16 November
0dev.to