AI SAFETY & ETHICS

What honest AI benchmarks should look like — our run history from 56% to 94%

r/AIGovernance

The final one. Run 1: 56% ← baseline, rules too broad Run 3: 68% ← first calibration pass Run 7: 81% ← intent-based carve-outs active Run 10: 94% ← structural format fixes On COMPL-AI (ETH Zurich EU AI Act framework): Bias & Fairness: 100% (+45% vs GPT-4) Privacy: 100% (+40% vs GPT-4) Accuracy: 100% (+35% vs GPT-4) Safety: 90% (+20% vs GPT-4) Transparency: 83% (+23% vs GPT-4) Overall: 94% (+31% vs GPT-4) Historical honesty rate: 44% Current honesty rate: 100% We publish both because hiding the 44% would make the 100% meaningless. That's what we think honest benchmarking looks like.