AI & ML
Predicting Risks Before They Happen: Vision-Language Reasoning for Autonomous Driving
arXiv cs.RO0 views
arXiv:2511.22928v2 Announce Type: replace Abstract: % Waiting until a driving hazard becomes directly visible can leave an autonomous vehicle little time to respond. Observable precursors, such as another vehicle's unexpected braking, can provide evidence of a hidden hazard and an opportunity for earlier risk mitigation. However, existing driving datasets and language reasoning formulations provide limited supervision for connecting these precursors to potential risks and appropriate responses. We introduce PotentialRiskQA, an ego-view driving dataset that marks precursor and risk appearance times and provides structured annotations linking scene evidence, potential risks, and mitigation actions. Building on this dataset, PR-Reasoner trains vision-language models to generate a precursor-centered reasoning chain through scene-level supervision and auxiliary tasks for scene understanding, precursor identification, risk inference, driving suggestions, and meta-actions. Experiments across multiple backbones show improved scene understanding, risk cognition, and action quality, with fewer unsupported risk claims on most models. Ablations show that supervising intermediate reasoning steps further reduces unsupported risk claims and improves action quality beyond scene-level training alone. On NAVSIM, the trained representations improve open-loop planning performance, demonstrating benefits beyond language-based evaluation.
Source:https://arxiv.org/abs/2511.22928PreviousChasing Stability: Humanoid Running via Control Lyapunov Function Guided Reinforcement LearningNextSelf-supervised Physics-Informed Manipulation of Deformable Linear Objects with Non-negligible Dynamics
Related posts
ragR: Retrieval-Augmented Generation and RAG Assessment in R
0arXiv stat.CO
Convergence and global optimality of Wasserstein--Fisher--Rao descent for Gaussian mixtures
0arXiv stat.CO
Pseudo-marginal Sampling for Selective Inference
0arXiv stat.CO
Microsoft Patch Tuesday November 2027 , (Tue, Nov 10th)
0SANS ISC
ISC Stormcast For Wednesday, November 11th, 2026 https://isc.sans.edu/podcastdetail/10174, (Wed, Nov 11th)
0SANS ISC

The Interface Questions That Matter in a Disposable-Inbox Workflow
0dev.to UX