AI & ML
A Low Similarity Score Does Not Show Independence after Source-Conditioned Repository Rewriting
arXiv cs.SE0 views
arXiv:2611.07887v1 Announce Type: new Abstract: Maintainers sometimes cite a low token-similarity score as evidence that an LLM-assisted rewrite of a copyleft project is independent of the original. We test what such a score can support under \emph{source-conditioned} rewriting: a coding agent keeps the original in its working copy, rewrites the repository, and iterates until a fixed behavioural harness passes, with no human edit to the code. On 69 rewrites of six copyleft Python projects we find that: \ding{182}~Agent-only rewriting is inexpensive and often yields low scores. Every controlled rewrite passes the harness after repair, usually within half an hour for the initial rewrite. Under a ground-up rearchitecture prompt, most rewrites fall below 25\% JPlag similarity and still pass the harness. \ding{183}~A single low score is an unreliable witness. Identical project--agent--prompt configurations produce wide spreads in similarity; run-to-run variation dominates project and agent effects, and in more than a third of configurations the three repeats straddle the threshold. Rewrites retain more of the original's imports and fingerprint facts than unrelated projects do, yet hand-written independent implementations of the same task often retain as much, and neither signal separates the two groups better than chance. Thus a low score on one rewrite is weak evidence of independence: another run of the same agent may score high. Claims based on similarity should report repeated generations, and candidate provenance signals should be checked against same task independent implementations, not only against unrelated projects.
Source:https://arxiv.org/abs/2611.07887PreviousCompositional Loop Invariant Inference for Multiphase Programs via Structured Neurosymbolic ReasoningNextRequirements Nobody Wrote Down: Emergence in a Public-Sector ML Pipeline
Related posts
Language models generate maximally activating examples for any residual direction
0dev.to

9 Timeouts in Claude Code, Codex and Gemini CLI That Cut Long Test Runs Short
0dev.to
Where JLPT learners lose points: 36,263 first answers by section
0dev.to
Stripe Billing or Chargebee: The Renewal Decides
0dev.to
Layer Rename & Cleanup: batch rename and delete empty layers in Aseprite (free Lite)
0dev.to

Open-Weight LLM vs Hosted API: What Self-Hosting Gives You That an API Can’t
0dev.to