Backend
A level is not a rank: an empirical audit of quantile-to-index conversion in 10 released conformal-prediction libraries
arXiv cs.SE0 views
arXiv:2611.23329v1 Announce Type: new Abstract: Context. A conformal interval at 0.90 keeps that guarantee only at the right rank: a fresh score falls at or below the rth smallest of n with probability r/(n + 1). The libraries we study instead hand a level to a quantile function, which can land elsewhere. At n = 20, the upper end of statsforecast's interval sits at position 18.05 where rank 19 is required. Objective. Where does installed code resolve the wrong rank, at what cost in coverage, and what does it return when no rank reaches the level? Method. We audit 39 sites where a level becomes an index in 10 pinned packages, a named set rather than a systematic search. 12 are classified by running them, 11 through their shared numpy method, the rest from source. Coverage is paired against the required rank on the same scores. Results. All 7 tabular implementations reach the required rank. In darts, on one code path, coverage is unchanged (0.0000) where the ranks agree and 0.0280 to 0.0560 lower where they differ; a second archive repeats that split but not its range. Below the feasibility floor, $n < 1/\alpha - 1$, of 14 public call paths 5 silently return a finite number; the rest raise or warn. Conclusions. Quantile interfaces take only a level; statsforecast's default calibrates below its floor. 6 of 19 upstream filings have merged, one fixing a coverage shortfall. A conformance suite classifies helpers by the rank they reach, and a checklist guides review.
Source:https://arxiv.org/abs/2611.23329PreviousHydroMind: A Checkable Agent for Autonomous Hydrological ResearchNextTraining for sustainable scientific software in the AI era: from code production to scientific stewardship
Related posts
What 50 Backlinks Taught Me About Building a Niche Site in Public
0dev.to Discuss
The Year "Prove You're Human" Became Law and Infrastructure
0dev.to Discuss

Beyond Management: Why Executive Leadership Coaching is the Missing Link in Modern Organizational Growth
0dev.to Discuss

Stop Eyeballing AI Benchmarks: Why Your Next Tool Evaluation Needs a Tiny Test Fixture
0dev.to Discuss
Meet Unmeshed: Run Your Apps, AI and People as One Workflow
0dev.to Productivity
When Technology Moves Back to the Device: What Local AI and Cloud Alternatives Mean for Business
0dev.to Productivity