AI RESEARCH
CyberThreat-Eval: Can Large Language Models Automate Real-World Threat Research?
arXiv CS.CL
•
ArXi:2603.09452v1 Announce Type: cross Analyzing Open Source Intelligence (OSINT) from large volumes of data is critical for drafting and publishing comprehensive CTI reports. This process usually follows a three-stage workflow -- triage, deep search and TI drafting. While Large Language Models (LLMs) offer a promising route toward automation, existing benchmarks still have limitations. These benchmarks often consist of tasks that do not reflect real-world analyst workflows. For example, human analysts rarely receive tasks in the form of multiple-choice questions.