Testing AI Agents Is Hard — Here's a Framework That Makes It Practical

We have Playwright for web apps. pytest for functions. Jest for components. But what do we have for testing AI agents? Basically nothing purpose-built. I've been building AI agents for a while and the testing story is painful. Unit tests don't capture agent behavior - an agent can pass all unit tests and still fail spectacularly in production because it called the wrong tool, leaked data to an unauthorized service, or got confused by an adversarial input. So I built AgentProbe - a behavioral testing framework for AI agents.