Skip to content

Commit ceb1a63

Browse files
committed
docs: make the hardware not-claimed list unambiguous about serving
'Production serving through the model API' was technically accurate, since the OLMo path does not go through the model API, but it reads as a blanket denial that real weights are served at all. It now separates the two: real weights are served over an OpenAI-shaped endpoint one request at a time, and the model API remains CPU-only metadata that the OLMo path does not touch.
1 parent 2a5360b commit ceb1a63

1 file changed

Lines changed: 6 additions & 2 deletions

File tree

docs/hardware-support.md

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -165,8 +165,12 @@ wrapper with a ROCm image that contains `rccl-tests`.
165165
- Support for AMD GPUs other than the current MI355X/gfx950 target.
166166
- Support for virtualized or container environments that do not expose `/dev/kfd`
167167
and `/dev/dri`.
168-
- Production serving, continuous batching, or OpenAI-compatible API behavior
169-
through the model API.
168+
- Production serving. The OLMo 2 path does serve real weights over an
169+
OpenAI-shaped endpoint, but one request at a time, with no batching, no
170+
scheduling across sequences, no auth and no quota.
171+
- Continuous batching, or any OpenAI-compatible API behaviour through the model
172+
API. The model API is CPU-only metadata and preflight, and the OLMo path does
173+
not go through it.
170174

171175
## Reporting Hardware Results
172176

0 commit comments

Comments
 (0)