Skip to content

Commit 2a5360b

Browse files
committed
docs: split the demo's claims by which lane is serving
The sandbox doc listed real weights and a real tokenizer under 'not claimed', which stopped being true when --olmo-config was added. The block now separates what is real in every mode, what is real only with a checkpoint attached, and what is not claimed either way. The two additions to that last group are the ones a reader would otherwise discover for themselves: the model is a base model rather than an instruction-tuned one, and only one request is served at a time because the KV cache holds a single sequence.
1 parent 1fb0836 commit 2a5360b

1 file changed

Lines changed: 15 additions & 5 deletions

File tree

docs/demo-sandbox.md

Lines changed: 15 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -144,16 +144,26 @@ python3 tools/check_demo_sandbox_static.py # CPU-only contract gate, in CI
144144

145145
## What the demo does and does not claim
146146

147-
Real:
147+
This depends on which lane is serving, so it is worth splitting.
148148

149-
- the OpenAI-shaped route, streaming, and receipt surface
150-
- on the GPU lane: a real kernel dispatch per request through raw KFD/AQL, a
149+
Real in every mode:
150+
151+
- the OpenAI-shaped route, streaming, and the receipt surface
152+
- on the GPU lane, a real kernel dispatch per request through raw KFD/AQL, a
151153
persistent worker owning the device, admission-time KV block reservations with
152154
capacity and release accounting, and scheduler-visible KV ownership checks
153155

154-
Not claimed:
156+
Real only with `--olmo-config`:
157+
158+
- real weights, a real tokenizer, and text the model actually generated
159+
- `synthetic: false` on `/v1/models` and `/api/health`
160+
161+
Not claimed in any mode:
155162

156-
- real weights, a real tokenizer, or chat quality of any kind
163+
- chat quality. `OLMo-2-0425-1B` is a base model, so it completes rather than
164+
converses, and no instruction tuning is involved here
165+
- concurrency. One request is served at a time because the KV cache holds one
166+
sequence, so a second caller waits
157167
- multi-user scheduling, auth, quota, or abuse controls
158168
- any throughput number derived from this page
159169

0 commit comments

Comments
 (0)