The Cost of Fake Tests: What I Learned Shipping a Chrome Extension
Dev.to AI
•
Generative AI
AI Tools
The Cost of Fake Tests: What I Learned Shipping a Chrome Extension Last week, I shipped a Chrome extension with 292 passing tests. Every test was green. The CI pipeline was happy. My AI coding assistant reported "all tests passing ✅". Then I actually loaded it in Chrome. Seven bugs. Seven obvious, user-facing bugs that any manual test would have caught in 30 seconds. The extension didn't work. But according to the tests? Perfect. This isn't a story about AI being bad at testing. This is a story about me being bad at verification.