AI RESEARCH
BEAVER: An Enterprise Benchmark for Text-to-SQL
arXiv CS.AI
•
ArXi:2409.02038v3 Announce Type: replace-cross Existing text-to-SQL benchmarks have largely been constructed from public databases with well-structured schemas and simplistic question-SQL pairs. While large language models (LLMs) excel on these settings, their efficacy in complex private enterprise environments, characterized by intricate schemas, domain knowledge, and analytical user queries involving sophisticated structures and functions, remains unproven. To bridge this gap, we