AI RESEARCH
Code Roulette: How Prompt Variability Affects LLM Code Generation
arXiv CS.LG
•
ArXi:2506.10204v2 Announce Type: replace-cross Code generation is one of the most active areas of application of Large Language Models (LLMs). While LLMs lower barriers to writing code and accelerate development process, the overall quality of generated programs depends on the quality of given prompts. Specifically, functionality and quality of generated code can be sensitive to user's background and familiarity with software development. It is therefore important to quantify LLM's sensitivity to variations in the input.