You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 03303a7
Browse filesBrowse the repository at this point in the historyBrowse files
| Overall |93.6% — baseline ran, but no comparable score was available; uplift unavailable |95.0% — baseline ran, but no comparable score was available; uplift unavailable |
38
+
| Overall |98.3% — baseline ran, but no comparable score was available; uplift unavailable |93.2% — baseline ran, but no comparable score was available; uplift unavailable |
| Discoverability | 100.0% — baseline ran, but no comparable score was available; uplift unavailable | 95.0% — baseline ran, but no comparable score was available; uplift unavailable |
| Efficiency |97.9% — baseline ran, but no comparable score was available; uplift unavailable |96.4% — baseline ran, but no comparable score was available; uplift unavailable |
| Efficiency |98.5% — baseline ran, but no comparable score was available; uplift unavailable |97.0% — baseline ran, but no comparable score was available; uplift unavailable |
44
44
45
45
**How to read this table:** baseline is the same task attempted without the target skill. Scores are rounded to one decimal; threshold-adjacent values use additional precision so their displayed band matches the verdict. Uplift is derived from those displayed scores and shown in percentage points.
46
46
@@ -54,15 +54,15 @@ Actual Tier 3 execution usage is reported for every observed agent/case pair and
54
54
55
55
| Agent | Dataset case | With skill | Without skill | Delta | Change | Coverage |
56
56
|---|---|---:|---:|---:|---:|---|
57
-
| claude-code | All cases |259,284|706,809| -447,525| -63.32% | skill 3/3; base 3/3 |
| ALL AGENTS | Dataset aggregate |322,663|1,178,613| -855,950| -72.62% | skill 6/6; base 6/6 |
66
66
67
67
Prompt tokens include cached reads, so total tokens are `prompt + completion` (cached is not added twice). The Efficiency score uses `(prompt - cached) + completion`. N/A means the relevant trajectory counters were not available; coverage is never estimated.
| Overall |93.6% — baseline ran, but no comparable score was available; uplift unavailable |95.0% — baseline ran, but no comparable score was available; uplift unavailable |
72
+
| Overall |98.3% — baseline ran, but no comparable score was available; uplift unavailable |93.2% — baseline ran, but no comparable score was available; uplift unavailable |
| Discoverability | 100.0% — baseline ran, but no comparable score was available; uplift unavailable | 95.0% — baseline ran, but no comparable score was available; uplift unavailable |
| Efficiency |97.9% — baseline ran, but no comparable score was available; uplift unavailable |96.4% — baseline ran, but no comparable score was available; uplift unavailable |
| Efficiency |98.5% — baseline ran, but no comparable score was available; uplift unavailable |97.0% — baseline ran, but no comparable score was available; uplift unavailable |
0 commit comments