← Evals Console
Grounding pass rate: the rows behind the number
How often does a live draft pass per-claim verification on the first try?
Numerator: live generate runs whose first attempt passed verify · Denominator: live generate runs (first attempts; template and cached drafts excluded)
Rows on this page: 72 (the denominator) · marked yes: 52 (the numerator)
Result: 72% (52/72) · real + synthetic
| Row | Table | What it is | In numerator? | Data |
|---|---|---|---|---|
| run_e71618cf | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: n/a (a retry) | no | real |
| run_syn_01_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: no | no | synthetic |
| run_syn_02_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: no | no | synthetic |
| run_syn_03_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: no | no | synthetic |
| run_syn_04_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: no | no | synthetic |
| run_syn_05_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_06_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_07_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_08_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_09_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_10_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_11_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_12_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_13_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_14_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_15_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_16_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_17_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: no | no | synthetic |
| run_syn_18_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: no | no | synthetic |
| run_syn_19_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: no | no | synthetic |
| run_syn_20_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_21_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_22_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_23_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_24_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_25_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_26_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_27_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_28_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_29_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_30_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_89b17a58 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: n/a (a retry) | no | real |
| run_syn_31_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: no | no | synthetic |
| run_syn_32_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: no | no | synthetic |
| run_syn_33_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_34_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_35_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_36_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_37_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_38_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_39_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_40_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_41_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_42_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_43_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_44_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_45_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: no | no | synthetic |
| run_syn_46_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_47_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_48_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_49_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_50_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_51_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_52_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_53_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_54_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_55_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_56_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_syn_57_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_blk_1_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_blk_2_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_blk_3_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_blk_4_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_blk_5_1 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: yes | yes | synthetic |
| run_53578912 | ai_runs | generate with generate@baseline · live · attempt 1 · passed verify first try: n/a (a retry) | no | real |
| run_b0359075 | ai_runs | generate with generate@baseline · live · attempt 1 · passed verify first try: n/a (a retry) | no | real |
| run_a11e269b | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: n/a (a retry) | no | real |
| run_a328e198 | ai_runs | generate with generate@v1 · live · attempt 1 · passed verify first try: n/a (a retry) | no | real |
| run_3cefe692 | ai_runs | generate with generate@baseline · live · attempt 1 · passed verify first try: n/a (a retry) | no | real |
| run_0e37afb9 | ai_runs | generate with generate@baseline · live · attempt 1 · passed verify first try: n/a (a retry) | no | real |
| run_2b9a65a5 | ai_runs | generate with generate@baseline · live · attempt 1 · passed verify first try: no | no | real |
| run_4d1715b5 | ai_runs | generate with generate@baseline · live · attempt 1 · passed verify first try: no | no | real |