General
Value and Policy Calibration from Execution Feedback for Socially Compatible Driving
arXiv cs.RO0 views
arXiv:2611.19969v1 Announce Type: new Abstract: Autonomous vehicle (AV) decisions at intersections affect the delay, braking, and motion smoothness of surrounding human-driven vehicles (HDVs). Learning socially compatible behavior requires connecting imagined interaction outcomes with feedback from executed actions. We propose a world-model reinforcement learning framework combines imagined policy improvement with direct value and policy calibration from finalized interactions, balancing AV progress with HDV interaction burden. An interaction-aware latent model supports imagination, while off-policy correction and replay updates enable observed rewards and transitions to supervise both the critic and actor. Simulation experiments at an unsignalized intersection achieve a 100% success and reductions in following-HDV acceleration variation of 65.5% and 44.0% relative to PIWM and DreamerV3, respectively. Ablations identify complementary roles for value calibration in reducing HDV burden and policy calibration in improving passage efficiency. Tests under out-of-distribution traffic shifts further show lower ego jerk and HDV acceleration variation than PIWM at comparable passage times.
Source:https://arxiv.org/abs/2611.19969PreviousCRAFT: A Robot-Agent Harness with Scope-Aware AdaptationNextPractice Is Not Free: Measuring the Embodied Cost of Reset-Free Robot Practice
Related posts
Men are more politically open-minded than women
0Hacker News New
What's Left of Europe's Technological Sovereignty
0Hacker News New
Tim Hortons App Sending Sensitive User Data to Israeli Cyber-Tech Company
0Hacker News New
LemonSqueezy Is Shutting Down
0Hacker News New
Varieties of Discourseposting
0Hacker News New
r/codeberg Banned
0Hacker News New