Batch 1 and 2 · eight lineages under the lenient grader

← The Grader Is the Optimizer · published copies: local paths, internal names, the canary's identity and the held-out evaluation are removed.

One row per Study; open a Study for its scores, decisions, diffs, traces and canary. Dev means use each Study's dev-rule metric (score_ungated); "head" is the latest kept revision. Agent failures count runs the framework classes as the Agent's own (invalid artifact, timeout, protocol violation, unverified Harness); "unscored" counts finished runs without a value of the rule metric, for example an Agent execution failure. Canary hits count candidate runs. Efficiency uses each revision's median dev run minutes and median dev run cost at Kimi's kimi-k3 list prices (¥ per million tokens: uncached input and 5-minute cache writes 20, cache hits 2, output incl. thinking 100); "latest vs parent" is the newest candidate with dev runs against its own parent; "loop extensions" lists iterations whose change added a Pi extension. Pages refresh when a Study's ledger or Meta Agent records change; screenshots are left out while runs are timed. Index written 2026-11-01 19:37 UTC.

StudyArmScopeLineageMeta AgentStateIterationsKept / reverted Baseline devHead devLast decisionAgent failuresUnscoredCanaryLatest vs parent (dev median)Head vs baseline (time / cost)Head cost per dev runLoop extensionsMeta costSnapshot
pi-f0-instructions-l1F0L1 instructions1kimi-k3 · highsearch41 / 30.7110.806 iter-001iter-004: revert (below_bar)0/4002/32iter-004: -0.9 min · 1.16× cost1.8× / 1.8×¥8.16–¥1044.9419:33
pi-f0-instructions-l2F0L1 instructions2kimi-k3 · highsearch41 / 30.7460.833 iter-001iter-004: revert (below_bar)0/4000/32iter-004: +2.5 min · 1.20× cost1.2× / 1.8×¥6.06–¥873.2219:33
pi-f1a-instructions-l1F1aL1 instructions1kimi-k3 · highsearch41 / 30.7040.878 iter-001iter-004: revert (below_bar)0/4002/32iter-004: +12.2 min · 1.72× cost1.6× / 1.9×¥9.03–¥1634.8419:34
pi-f1a-instructions-l2F1aL1 instructions2kimi-k3 · highsearch41 / 20.7210.898 iter-001iter-003: revert (below_bar)1/3200/23iter-003: -5.9 min · 0.66× cost1.8× / 1.9×¥10.42–¥783.0819:34
pi-f1a-instructions-l3F1aL1 instructions3kimi-k3 · highsearch41 / 20.7550.916 iter-001iter-004: revert (below_bar)0/3202/24iter-004: -0.2 min · 0.95× cost2.1× / 2.2×¥11.81–¥1060.1019:35
pi-f2-instructions-l1F2L1 instructions1kimi-k3 · highsearch41 / 30.7020.917 iter-001iter-004: revert (below_bar)0/4010/32iter-004: +3.8 min · 1.23× cost1.1× / 1.4×¥7.50–¥1176.1719:35
pi-f2-instructions-l2F2L1 instructions2kimi-k3 · highsearch72 / 50.7380.950 iter-004iter-007: revert (below_bar)0/6402/56iter-007: +9.0 min · 1.80× cost1.5× / 1.3×¥6.68–¥2185.2519:36
pi-f2-loop-l1F2L3 loop1kimi-k3 · highsearch41 / 30.7490.958 iter-001iter-004: revert (more_flagged_runs)0/4000/31iter-004: -2.1 min · 1.16× cost2.0× / 2.1×¥7.91iter-004¥1294.1619:37