Backend
Identifying and Mitigating API Misuse in Large Language Models
arXiv cs.SE0 views
arXiv:2503.22821v3 Announce Type: replace Abstract: API misuse in code generated by large language models (LLMs) presents a serious and growing challenge in software development, as although LLMs demonstrate impressive code generation capabilities, their interactions with complex library APIs are often error-prone and can lead to software failures and vulnerabilities. In this paper, we conduct a large-scale study of API misuse patterns in LLM-generated code by analyzing both method selection and parameter usage across Python and Java, using three representative LLMs: StarCoder-7B, Qwen2.5-Coder-7B, and GitHub Copilot. Based on extensive manual annotation of 3,209 method-level and 3,492 parameter-level misuses, we identify and categorize four recurring misuse types by building on and refining prior API misuse taxonomies. Our evaluation of the three LLMs reveals persistent challenges in API usage, particularly hallucination and intent misalignment. To address these issues, we propose Dr.Fix, an LLM-based automatic repair approach guided by our taxonomy, which improves repair accuracy compared to baseline prompting and existing repair methods, achieving gains of up to 38.4 BLEU and up to 72 more exact matches on benchmark datasets. This work offers important insights into the current limitations of LLMs in API usage and points to directions for improving automated misuse repair in code generation systems.
Source:https://arxiv.org/abs/2503.22821PreviousA Taxonomy of Real Faults in Hybrid Quantum-Classical ArchitecturesNextTraining Language Model Agents to Find Vulnerabilities with CTF-Dojo
Related posts
![Robot Middleware and ROS2 — Ch.06: ROS2 Security [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F3oowmzpb4qkk5km0di1k.png)
Robot Middleware and ROS2 — Ch.06: ROS2 Security [EN]
0dev.to Programming
![Robot Middleware and ROS2 — Ch.07: ROS2 Lifecycle Management [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fx3a51weo0z1ob95yn3x2.png)
Robot Middleware and ROS2 — Ch.07: ROS2 Lifecycle Management [EN]
0dev.to Programming
![Robot Middleware and ROS2 — Ch.08: ROS2 Deployment and DevOps [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F9z4fmoxmqqngiro7boaa.png)
Robot Middleware and ROS2 — Ch.08: ROS2 Deployment and DevOps [EN]
0dev.to Programming
![Robot Middleware and ROS2 — Ch.09: ROS2 for AMR [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fmrvn70kciyfra1s6m77r.png)
Robot Middleware and ROS2 — Ch.09: ROS2 for AMR [EN]
0dev.to Programming
![Robot Middleware and ROS2 — Ch.10: ROS2 for Physical AI [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fboyfq92kdiuwiwz8xsoa.png)
Robot Middleware and ROS2 — Ch.10: ROS2 for Physical AI [EN]
0dev.to Programming
![Robot Middleware and ROS2 — Ch.12: ROS2 Case Studies [EN]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fw7pygqy790h9vw6mz16j.png)
Robot Middleware and ROS2 — Ch.12: ROS2 Case Studies [EN]
0dev.to Programming