FrontierCode Diamond

Coding

The 50 hardest FrontierCode tasks: the toughest production-code problems, graded on whether maintainers would merge the patch. Scores stay low by design. Higher is better.

Official source

Diamond is the 50 most difficult FrontierCode tasks, the hardest production-code problems from real open source repositories. They use the same maintainer-merge rubric with hard blocking criteria (correctness, regression safety, scope). Score is the gated weighted rubric value, counted only once a trial clears every blocker (else 0), averaged over the tasks. As the toughest agentic-coding measure on the board, scores stay low.