run panoptes-696da4d5
2026-06-04 16:31:35·strategy: all·demo_all.duckdb
items
22
judge calls
396
UQ results
154
cost
$1.56
440.0k tokens
cost by judge
total
$1.56
claude-haiku$0.378claude-sonnet$1.16gpt-4o-mini$0.023
score distribution (point pass, by judge)
items
| item | family | scores | UQ | |
|---|---|---|---|---|
| HE/0 | code | claude-haiku 0.800 claude-sonnet 0.950 gpt-4o-mini 1.000 | 7 blob(s) | drill |
| HE/1 | code | claude-haiku 1.000 claude-sonnet 1.000 gpt-4o-mini 0.800 | 7 blob(s) | drill |
| HE/10 | code | claude-haiku 1.000 claude-sonnet 1.000 gpt-4o-mini 1.000 | 7 blob(s) | drill |
| HE/11 | code | claude-haiku 0.500 claude-sonnet 0.800 gpt-4o-mini 1.000 | 7 blob(s) | drill |
| HE/12 | code | claude-haiku 1.000 claude-sonnet 1.000 gpt-4o-mini 1.000 | 7 blob(s) | drill |
| HE/13 | code | claude-haiku 0.650 claude-sonnet 1.000 gpt-4o-mini 1.000 | 7 blob(s) | drill |
| HE/14 | code | claude-haiku 1.000 claude-sonnet 1.000 gpt-4o-mini 1.000 | 7 blob(s) | drill |
| HE/15 | code | claude-haiku 1.000 claude-sonnet 1.000 gpt-4o-mini 1.000 | 7 blob(s) | drill |
| HE/16 | code | claude-haiku 1.000 claude-sonnet 1.000 gpt-4o-mini 1.000 | 7 blob(s) | drill |
| HE/17 | code | claude-haiku 1.000 claude-sonnet 0.950 gpt-4o-mini 0.800 | 7 blob(s) | drill |
| HE/18 | code | claude-haiku 1.000 claude-sonnet 0.950 gpt-4o-mini 1.000 | 7 blob(s) | drill |
| HE/19 | code | claude-haiku 1.000 claude-sonnet 0.950 gpt-4o-mini 1.000 | 7 blob(s) | drill |
| HE/2 | code | claude-haiku 1.000 claude-sonnet 1.000 gpt-4o-mini 1.000 | 7 blob(s) | drill |
| HE/20 | code | claude-haiku 0.800 claude-sonnet 0.850 gpt-4o-mini 0.800 | 7 blob(s) | drill |
| HE/21 | code | claude-haiku 0.500 claude-sonnet 0.950 gpt-4o-mini 1.000 | 7 blob(s) | drill |
| HE/3 | code | claude-haiku 1.000 claude-sonnet 1.000 gpt-4o-mini 1.000 | 7 blob(s) | drill |
| HE/4 | code | claude-haiku 0.500 claude-sonnet 1.000 gpt-4o-mini 1.000 | 7 blob(s) | drill |
| HE/5 | code | claude-haiku 1.000 claude-sonnet 1.000 gpt-4o-mini 1.000 | 7 blob(s) | drill |
| HE/6 | code | claude-haiku 1.000 claude-sonnet 1.000 gpt-4o-mini 0.800 | 7 blob(s) | drill |
| HE/7 | code | claude-haiku 1.000 claude-sonnet 1.000 gpt-4o-mini 1.000 | 7 blob(s) | drill |
| HE/8 | code | claude-haiku 1.000 claude-sonnet 1.000 gpt-4o-mini 0.800 | 7 blob(s) | drill |
| HE/9 | code | claude-haiku 1.000 claude-sonnet 1.000 gpt-4o-mini 1.000 | 7 blob(s) | drill |