Backend
Mechanistic Interpretability for End-to-End Self-Driving
arXiv cs.RO0 views
arXiv:2610.41185v1 Announce Type: new Abstract: End-to-end (E2E) autonomous driving models achieve strong planning performance but remain largely opaque, limiting observability and trust. We apply mechanistic interpretability to E2E driving by training Sparse Autoencoders (SAEs) on the internal activations of a simple, single-camera end-to-end path planning model. Unsupervised clustering of SAE latents reveals interpretable structure aligned with route intent, vehicle speed, and braking behavior, recovering route intent with 98.3% accuracy without supervision. Through paired counterfactual image edits, we further show that specific SAE features are visually grounded and systematically respond to scene changes such as traffic light state and stop sign presence. Steering individual SAE latents produces predictable, monotonic changes in planner outputs including lateral displacement, curvature, and braking. Finally, we demonstrate a practical application of these representations: we build a lightweight adapter trained on SAE latents that reduces trajectory selection error by 3.44%, outperforming an equivalent adapter that omits SAE latents, confirming that the sparse representation captures useful information for interpretability. Code and visualizations are available at https://mgagvani.github.io/mechanistic-interpretability-for-e2e-driving/
Source:https://arxiv.org/abs/2610.41185PreviousVeloxity: Towards Memory-Safe UAV Embedded Firmware using the Rust Programming LanguageNextA Capability-Aware Backup-Recoverability Filter for Heterogeneous Multi-Robot Navigation
Related posts

Discord is about to get way, way faster on your Android phone
09to5Google
Six Serving Engines on One EC2 G6: Gemma 4 E2B on an NVIDIA L4
0dev.to
The 12-second 'up next' countdown in my 1.17 MB player: auto-advance without the annoyance
0dev.to

Building Polymarket Trading Bot: From Backtesting to Live Trading(Market Maker)
0dev.to
How to design MCP tools for agents
0dev.to
I Launched Aharon Cloud: An Israeli SMS API with Webhooks and Node.js
0dev.to