Skip to content

Commit b14783f

Browse files
Kartik Anejaclaude
authored andcommitted
Add dashboard demo screenshots to README
docs/screenshots/: - 01-runs-list.png — home page with runs table + compare-runs picker - 02-run-detail.png — events for a run with judge scores + reasoning - 03-run-diff.png — run-level diff: judge means, deltas, score distribution bars (A=zinc, B=indigo), top regressions/improvements, matched-prompt table - 04-event-diff.png — event-level diff: word-level LCS on prompts and completions + judge-score deltas Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
1 parent 54e9cbe commit b14783f

5 files changed

Lines changed: 18 additions & 0 deletions

File tree

README.md

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -21,6 +21,24 @@ See [PRODUCT.md](./PRODUCT.md) for the full writeup. TL;DR:
2121
- **Pain:** No CI for prompts. No regression detection. Excel sheets and Slack screenshots.
2222
- **Why now:** LLM eval is the #1 underserved 2026 topic. Braintrust raised $36M but is closed + paid.
2323

24+
## Demo
25+
26+
**Runs list** — every eval run reported by the SDK or CLI, with a "Compare two runs" picker at the bottom:
27+
28+
![evalstack — runs list](./docs/screenshots/01-runs-list.png)
29+
30+
**Run-level diff** — judge means with deltas, 10-bucket score histograms per judge (A in zinc, B in indigo), top regressions/improvements panels, and a per-prompt matched table with drill-down to event-level diff:
31+
32+
![evalstack — run-level diff](./docs/screenshots/03-run-diff.png)
33+
34+
**Run detail** — every event in the run with per-event judge scores + reasoning + a compare-events picker at the bottom:
35+
36+
![evalstack — run detail](./docs/screenshots/02-run-detail.png)
37+
38+
**Event-level diff** — word-level LCS diff on prompts + completions plus per-judge A-vs-B deltas:
39+
40+
![evalstack — event-level diff](./docs/screenshots/04-event-diff.png)
41+
2442
## What works today (alpha MVP)
2543

2644
- **Python SDK** — one decorator (`@evalstack.trace`) captures LLM calls + outputs

docs/screenshots/01-runs-list.png

45.6 KB
Loading

docs/screenshots/02-run-detail.png

171 KB
Loading

docs/screenshots/03-run-diff.png

91.2 KB
Loading

docs/screenshots/04-event-diff.png

52.9 KB
Loading

0 commit comments

Comments
 (0)