AI RESEARCH
Multilingual and Domain-Agnostic Tip-of-the-Tongue Query Generation for Simulated Evaluation
arXiv CS.CL
•
ArXi:2604.21096v1 Announce Type: cross Tip-of-the-Tongue (ToT) retrieval benchmarks have largely focused on English, limiting their applicability to multilingual information access. In this work, we construct multilingual ToT test collections for Chinese, Japanese, Korean, and English, using an LLM-based query simulation framework. We systematically study how prompt language and source document language affect the fidelity of simulated ToT queries, validating synthetic queries through system rank correlation against real user queries.