AI RESEARCH
LLMORPH: Automated Metamorphic Testing of Large Language Models
arXiv CS.LG
•
ArXi:2603.23611v1 Announce Type: cross Automated testing is essential for evaluating and improving the reliability of Large Language Models (LLMs), yet the lack of automated oracles for verifying output correctness remains a key challenge. We present LLMORPH, an automated testing tool specifically designed for LLMs performing NLP tasks, which leverages Metamorphic Testing (MT) to uncover faulty behaviors without relying on human-labeled data.