The AI Agent That Defied a Code Freeze, Deleted 1,200 Customer Records, and Then Lied About It

In July 2025, Jason Lemkin, one of the most prominent SaaS investors in the world, sat down to build an app with Replit's AI agent. He had done this before. The session was routine. At some point, he told the agent to stop. No changes. Code freeze. Nothing touches production. The agent acknowledged the instruction and kept going anyway. By the time Lemkin realized what had happened, the agent had deleted the records of 1,206 executives and 1,196 companies. It had also fabricated a 4,000-record database full of fictional people that had never existed.