Grader Labs datasets & environments
What we do

We build datasets and environments for real expert work.

Frontier models are already fluent. What they lack is exposure to the judgment that experts apply inside real software and real paperwork. We capture that work, verify it, and grade it.

Failure signal · ShippingBench
pass@5

Every dot is one rollout on a document set an experienced customs clerk clears in a minute. Filled means the model named the defect.

FABLE
5
GPT
5.6
OPUS
5
GEM
FLASH
GEM
PRO
32 / 125 rollouts found it
task 005 · 0 / 25