Backend
Mechanistic Interpretability for End-to-End Self-Driving
arXiv cs.RO0 views
arXiv:2610.41185v1 Announce Type: new Abstract: End-to-end (E2E) autonomous driving models achieve strong planning performance but remain largely opaque, limiting observability and trust. We apply mechanistic interpretability to E2E driving by training Sparse Autoencoders (SAEs) on the internal activations of a simple, single-camera end-to-end path planning model. Unsupervised clustering of SAE latents reveals interpretable structure aligned with route intent, vehicle speed, and braking behavior, recovering route intent with 98.3% accuracy without supervision. Through paired counterfactual image edits, we further show that specific SAE features are visually grounded and systematically respond to scene changes such as traffic light state and stop sign presence. Steering individual SAE latents produces predictable, monotonic changes in planner outputs including lateral displacement, curvature, and braking. Finally, we demonstrate a practical application of these representations: we build a lightweight adapter trained on SAE latents that reduces trajectory selection error by 3.44%, outperforming an equivalent adapter that omits SAE latents, confirming that the sparse representation captures useful information for interpretability. Code and visualizations are available at https://mgagvani.github.io/mechanistic-interpretability-for-e2e-driving/
Source:https://arxiv.org/abs/2610.41185PreviousVeloxity: Towards Memory-Safe UAV Embedded Firmware using the Rust Programming LanguageNextA Capability-Aware Backup-Recoverability Filter for Heterogeneous Multi-Robot Navigation
Related posts
Replaying 153 Claude Code & Codex Sessions for Production Blast Radius (and Catching 247 Root SSH Calls)
0dev.to
I turned Fortnite's mid-season schedule into a tiny JSON dataset
0dev.to

Warum du und der Finder unterschiedliche Ordnergrößen anzeigen
0dev.to
Measure Fact Fidelity Before You Let a Model Redraft a Doc Section
0dev.to

Hardening Pydantic v2: Eliminating Silent Failures and Schema Drift at the API Ingress
0dev.to
Passing Alone Is Not Passing: An Order-Sensitivity Gate for Agent Patches
0dev.to