Skip to content

Commit d32de9a

Browse files
committed
[docs] Spark guide: satisfy PyMarkdown (reflow list line, blank lines around code blocks)
Reword the "weights + activations + KV" line so the wrapped "+ KV" isn't misread as a list marker (the auto-fix would corrupt it to "- KV"), and add the blank lines PyMarkdown wants around a fenced code block.
1 parent bb49d7a commit d32de9a

1 file changed

Lines changed: 5 additions & 2 deletions

File tree

docs/getting_started/installation/spark_performance.md

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -83,8 +83,9 @@ The GB10 has **no separate VRAM** — CPU and GPU share one 128 GB LPDDR5X pool
8383
`peak_memory_mb` (reported on the generation result and by the performance
8484
benchmark), which is measured inside the worker that runs the model.
8585
- **The 128 GB is a *working-set* ceiling, not storage** — the model cache lives
86-
on the NVMe (3.7 TB, ample). What has to fit in 128 GB is weights + activations
87-
+ KV, and — critically — the **VAE decode buffers**, which is why tiling matters
86+
on the NVMe (3.7 TB, ample). What has to fit in 128 GB is the weights,
87+
activations, and KV cache — and, critically, the **VAE decode buffers**, which
88+
is why tiling matters
8889
(an untiled high-res decode can spike the pool into swap and lock the box).
8990

9091
The recommended few-step models are comfortable here: their weights are small
@@ -148,9 +149,11 @@ is power-cycled. To avoid it:
148149

149150
- **Inference:** keep **VAE tiling on** (the default), use sane resolution/frames,
150151
and run under `nice -n 19`:
152+
151153
```bash
152154
nice -n 19 nohup python your_script.py > run.log 2>&1 &
153155
```
156+
154157
- **Builds** (flash-attn, kernel): `nice -n 19`, `MAX_JOBS=2`, `nohup`. Never a
155158
bare foreground high-parallelism build.
156159
- Leave `*_cpu_offload` at the example defaults — "CPU" offload is the *same*

0 commit comments

Comments
 (0)