AI RESEARCH
KOCO-BENCH: Can Large Language Models Leverage Domain Knowledge in Software Development?
arXiv CS.LG
•
ArXi:2601.13240v2 Announce Type: replace-cross Large language models (LLMs) excel at general programming but struggle with domain-specific software development, necessitating domain specialization methods for LLMs to learn and utilize domain knowledge and data. However, existing domain-specific code benchmarks cannot evaluate the effectiveness of domain specialization methods, which focus on assessing what knowledge LLMs possess rather than how they acquire and apply new knowledge, lacking explicit knowledge corpora for developing domain specialization methods.