AI RESEARCH

Flying Pigs, FaR and Beyond: Evaluating LLM Reasoning in Counterfactual Worlds

arXiv CS.LG

ArXi:2505.22318v2 Announce Type: replace-cross A fundamental challenge in reasoning is navigating hypothetical, counterfactual worlds where logic may conflict with ingrained knowledge. We investigate this frontier for Large Language Models (LLMs) by asking: Can LLMs reason logically when the context contradicts their parametric knowledge? To facilitate a systematic analysis, we first