Which grader is right? exact

Graders agree on clear differences, not on slight ones

Left: how often an earlier grader version agreed with careful agent labels on pairs of pages (a small sample). Right: every held-out page scored by both graders. Points below the diagonal lost score under the strict grader. Click a harness to show or hide it.