← Evals Console

Replay pass rate: the rows behind the number

Do the latest drafts still get right what reps corrected before?

Numerator: regression tests passing on their latest replay with generate@v1 · Denominator: regression tests replayed with generate@v1

Rows on this page: 2 (the denominator) · marked yes: 0 (the numerator)

Result: 0% (0/2) · real + synthetic

RowTableWhat it isIn numerator?Data
rp_d2ac0ae3replay_resultstest tc_987ddbe7 · generate@v1 · failnoreal
rp_1a4ca0fdreplay_resultstest tc_ab51ab2e · generate@v1 · failnoreal