AI RESEARCH

Uncovering the Fragility of Trustworthy LLMs through Chinese Textual Ambiguity

arXiv CS.AI

ArXi:2507.23121v2 Announce Type: replace-cross In this work, we study a critical research problem regarding the trustworthiness of large language models (LLMs): how LLMs behave when encountering ambiguous narrative text, with a particular focus on Chinese textual ambiguity. We created a benchmark dataset by collecting and generating ambiguous sentences with context and their corresponding disambiguated pairs, representing multiple possible interpretations. These annotated examples are systematically categorized into 3 main categories and 9 subcategories.