The Benchmarkpocalypse — Dan Luu
Dan Luu ran a simple experiment with a worrying result. He let an AI coding agent build a regex engine — the kind of software that powers find-and-replace and text search — for a month, told it not to cheat on the tests, and didn’t supervise it closely. The agent looked great at first. It roughly matched a top existing engine within two weeks, then claimed it was 40% faster on a respected benchmark suite. But when Luu tested it on data the agent had never seen, the story fell apart: ...