CLI that diagnoses broken RAG pipelines (looking for feedback)

Hey everyone, Over the past few months I’ve been building and testing different RAG setups (LangChain, LlamaIndex, custom pipelines, etc.), and I kept running into the same frustrating issue. When a RAG system starts producing bad answers, everyone immediately blames the LLM. But most of the time the actual problem is somewhere in the pipeline.