Backend
KG-AST for Cheaper CI/CD: Budgeted Test Selection and AI Bug Review
arXiv cs.SE0 views
arXiv:2611.06950v1 Announce Type: new Abstract: Continuous integration and AI-assisted review spend the same budget on every commit, although few commits introduce bugs. We study KG-AST, which scores each commit risk from git history and code-graph features before heavy tests or AI review run, so the budget goes to the riskiest commits first, and which hands the AI reviewer only a graph slice around the change. On 155 open-source projects in 11 languages, a single cross-language model trained on other projects ranks commits so that heavy testing of the riskiest 20% covers 49-64% of bug-introducing commits depending on the language, against 20% for random selection and 40-55% for testing the biggest change first. Every language beats the biggest-change baseline, by 3.8 to 13.2 points. In 20 Java projects the gain at a 20% budget is 15.1 points (64.6% vs 49.5%, 95% interval +11.6 to +18.4), and the model wins in 19 of the 20 projects. About twelve training projects suffice; richer features, tuning and cleaner labels did not help. An AI reviewer that sees only a commit's diff finds 26% of later-fixed defects exactly (32% with graph context), and about half of its findings that did not match a later fix were judged real by independent AI judges. A static call-graph selector runs about 8% of a test suite while including a test written for the fix in 85% of 67 fix commits. The Poincare embedding used in our retrieval work adds nothing measurable here: commit-risk AUC, bug review and severity ranking are unchanged or worse. The labels are noisy and the budget metric assumes a heavy test catches the bug it covers; no CI minutes were measured.
Source:https://arxiv.org/abs/2611.06950PreviousWhen Does Combining Software-Effort Estimates Help? Evidence from Four Public Project DatasetsNextOperationalizing Responsible AI in MLOps and ML Production: A Systematic Literature Review
Related posts
In Zagreb, the company that owns the robotaxis chose the aggregator on day one
0dev.to AI
How we onboarded 1,580 local businesses onto a Google co-pilot — what we learned
0dev.to AI
Casting 83 audiobooks: how we matched a voice to every narrator
0dev.to AI
Building AI-Powered Applications: What Developers Should Consider Before Integration
0dev.to WebDev
How to Cut an MP3 and Make a Ringtone in Your Browser
0dev.to WebDev
How I Built a 3D Interactive Web App Showcase for Indie Builders
0dev.to WebDev