Skip to content

Commit 0102d86

Browse files
haizhongzhengclaude
andcommitted
Add the exported dataset to the repository
dataset/ holds the task streams and environments of all nine scenarios (as written by `slb export-data`), the leaderboard CSV and the content fingerprints. A test checks that the files match a fresh export. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
1 parent 7943e1e commit 0102d86

72 files changed

Lines changed: 10724 additions & 4 deletions

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎README.md‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -135,7 +135,7 @@ learning work and held-out test). Per-setting scores are in [docs/leaderboard.cs
135135
- [Benchmark](docs/benchmark.md): the EESD formulation, domains, tiers and scenarios
136136
- [Protocol](docs/protocol.md): what the agent and a learning method may see, budgets, scoring
137137
- [Methods](docs/methods.md): the three included methods and how to add your own
138-
- [Data](docs/data.md): the dataset files and their fields
138+
- [Data](docs/data.md): the dataset files in `dataset/` and their fields
139139

140140
## Repository layout
141141

@@ -153,6 +153,7 @@ servelearnbench/
153153
tests/ offline tests (no API calls)
154154
docs/ documentation and the leaderboard CSV
155155
website/ the project page (GitHub Pages), built by website/build.py
156+
dataset/ the exported task streams and environments of all nine scenarios
156157
examples/
157158
```
158159

‎dataset/README.md‎

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
# ServeLearnBench dataset
2+
3+
Every scenario's task stream and environment, as written by `slb export-data --out dataset`.
4+
The same files are published on Hugging Face as
5+
[haizhongzheng/ServeLearnBench](https://huggingface.co/datasets/haizhongzheng/ServeLearnBench).
6+
Layout and fields are described in [docs/data.md](../docs/data.md).
7+
8+
The `evaluator` fields of each task and `environments/*/windows.json` describe the hidden policy.
9+
Never show them to an agent or a learning method.

‎dataset/data/banking_l1/serving.jsonl‎

Lines changed: 336 additions & 0 deletions
Large diffs are not rendered by default.

‎dataset/data/banking_l1/test.jsonl‎

Lines changed: 178 additions & 0 deletions
Large diffs are not rendered by default.

‎dataset/data/banking_l2/serving.jsonl‎

Lines changed: 500 additions & 0 deletions
Large diffs are not rendered by default.

‎dataset/data/banking_l2/test.jsonl‎

Lines changed: 387 additions & 0 deletions
Large diffs are not rendered by default.

‎dataset/data/banking_l3/serving.jsonl‎

Lines changed: 600 additions & 0 deletions
Large diffs are not rendered by default.

‎dataset/data/banking_l3/test.jsonl‎

Lines changed: 551 additions & 0 deletions
Large diffs are not rendered by default.

‎dataset/data/pitch_l1/serving.jsonl‎

Lines changed: 216 additions & 0 deletions
Large diffs are not rendered by default.

‎dataset/data/pitch_l1/test.jsonl‎

Lines changed: 96 additions & 0 deletions
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)