AI & ML
Directional Confusions Reveal Divergent Inductive Biases Through Rate-Distortion Geometry in Human and Machine Vision
arXiv math.IT0 views
arXiv:2604.21909v3 Announce Type: replace-cross Abstract: Humans and modern vision models can reach similar classification accuracy while making systematically different kinds of mistakes -- differing not in how often they err, but in who gets mistaken for whom and in which direction. We show that these directional confusions reveal distinct inductive biases that are invisible to accuracy alone. Using matched human and deep vision model responses on a natural-image categorization task under 12 perturbation types, we quantify asymmetry in confusion matrices and link it to the shape of the information-error trade-off. We characterize this trade-off geometry using three signatures extracted from the rate-distortion (RD) frontier: slope beta, curvature kappa and efficiency (AUC). We find that humans exhibit broad but weak asymmetries, whereas deep vision models show sparser, stronger directional collapses. Robustness training reduces global asymmetry but fails to recover the human-like breadth-strength profile of graded similarity. Mechanistic simulations further show that different asymmetry organizations shift the RD frontier in opposite directions, even when matched for performance. Together, these results position directional confusions and RD geometry as compact, interpretable signatures of inductive bias under distribution shift.
Source:https://arxiv.org/abs/2604.21909PreviousSimilarity-Sensitive Entropy under Representation Change and InferenceNextLazyWeights: Decode-on-Demand Edge LLMs
Related posts

Senator slams Commerce Secretary for flow of Nvidia AI chips to China
0The Verge
They Found You Through a Photograph…
0dev.to
The Joy of Boring Code: Why Writing "Clever" Code is Overrated
0dev.to
From fMRI to images: what Brain-IT reconstructs—and what it does not
0dev.to
Vad ska vi automatisera först? En poängmodell för småföretag
0dev.to

Octopus Energy is bringing its sold-out plug-in solar panels to UK small businesses, says move was a 'no-brainer' following huge demand
0TechRadar