VerifierBench: AI-written checkers reject valid solutions
VerifierBench tests whether agents can write executable task checkers. An agent is a model running a multi-step task with tools. A checker must recognize different valid solutions, including ones its author never chose. The authors report a …