AI & ML
Where KV-Cache Error Lives in Looped Language Models: A Diagnostic Study of Ouro and Huginn
arXiv cs.DC0 views
arXiv:2610.41825v1 Announce Type: new Abstract: A looped language model applies one block of layers 4 times per token and keeps a key/value (KV) plane for each loop. We study where storage error changes the next-token distribution and how shared-weight error accumulates, using Ouro-1.4B (4 loops) on GSM8K and MATH and Huginn-0125 (32 loops) on GSM8K-derived chains, with dense, simulated quantization. Per unit of error, values carry 94% of the diagonal Fisher mass, but measured KL is dominated by keys with larger quantization errors. Local second-order prediction follows the measured KL of typical sequences, including 136 held-out chains, but misses a few confident rows, and a local second-order factor for shared weights at 32 loops ranges from 1.65 (INT8) to 4.09 (INT4), so it depends on the error direction. A cell-level allocator lowers one-step KL at 25-48% of BF16 bytes, while paired task-accuracy comparisons depend on budget and the 25% gap against K4V2 shrinks to near zero under a post hoc answer-extraction check. A later Ouro-2.6B test retains the key/value split but falsifies measured-cost allocation's advantage over Fisher at 31%; across all 21 ledger registrations, 60 of 176 criteria failed.
Source:https://arxiv.org/abs/2610.41825PreviousMemX: Memory-Aware Automatic Parallelism for Cross-Vendor Heterogeneous GPU TrainingNextA Deterministic Commitment Rule over Unstructured DAGs for Optimistic Replication
Related posts
Release Radar, 03–09.11: 27 flagged releases with verbatim quotes
0dev.to Python
chmod 755 Is Not 'Read, Write, Execute': 5 Permission Traps
0dev.to DevOps
Building a Production-Oriented MLOps Prototype with Python and FastAPI
0dev.to Docker

A profile of Alice Huang, a suspected Chinese spy who founded Megaspeed in 2023 and spent years in Jensen Huang's orbit; Megaspeed's Nvidia imports top $4.6B (Mark Anderson/Bloomberg)
0Techmeme

Meta says it is globally expanding Instagram's AI age estimation tech to apply Teen Account protections to teens aged 13 to 17 who misrepresented their age (Jess Weatherbed/The Verge)
0Techmeme

Alphabet's Wing plans to invest up to $125M over two years to build a 15,000-square-foot facility in Fort Worth, Texas, to produce tens of thousands of drones (Mark R. Long/Wall Street Journal)
0Techmeme