Skip to content

Commit e0ea74f

Browse files
committed
docs(performance): add improved NVFP4 benchmarks
Signed-off-by: Malay Nagda <malayn@nvidia.com>
1 parent 90c853f commit e0ea74f

1 file changed

Lines changed: 3 additions & 0 deletions

File tree

‎docs/performance-summary.md‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -43,6 +43,7 @@ The performance data includes:
4343
| System | #-GPUs | Precision | GBS | MBS | Sequence Length | TP | PP | CP | VP | EP | Tokens / sec / GPU | Model TFLOP / sec / GPU |
4444
|--------|--------|-----------|-----|-----|-----------------|----|----|----|----|----|-----------------------|-------------------------|
4545
| DGX-GB300 | 256 | MXFP8 | 4096 | 1 | 4096 | 1 | 2 | 1 | 8 | 32 | 6288 | 1636 |
46+
| DGX-GB300 | 256 | NVFP4 | 4096 | 1 | 4096 | 1 | 2 | 1 | 8 | 32 | 6640 | 1728 |
4647
| DGX-GB200 | 256 | MXFP8 | 4096 | 1 | 4096 | 1 | 4 | 1 | 4 | 64 | 4912 | 1277 |
4748

4849
#### Model: DeepSeekV4 Flash
@@ -73,7 +74,9 @@ The performance data includes:
7374
| System | #-GPUs | Precision | GBS | MBS | Sequence Length | TP | PP | CP | VP | EP | Tokens / sec / GPU | Model TFLOP / sec / GPU |
7475
|--------|--------|-----------|-----|-----|-----------------|----|----|----|----|----|-----------------------|-------------------------|
7576
| DGX-GB300 | 256 | MXFP8 | 8192 | 2 | 4096 | 1 | 4 | 1 | 12 | 32 | 8832 | 1306 |
77+
| DGX-GB300 | 256 | NVFP4 | 8192 | 2 | 4096 | 1 | 4 | 1 | 12 | 32 | 9216 | 1365 |
7678
| DGX-GB200 | 256 | MXFP8 | 8192 | 1 | 4096 | 1 | 8 | 1 | 3 | 32 | 7264 | 1076 |
79+
| DGX-GB200 | 256 | NVFP4 | 8192 | 1 | 4096 | 1 | 8 | 1 | 3 | 32 | 8000 | 1185 |
7780

7881
#### Model: Nemotron_3_5_Lightning
7982

0 commit comments

Comments
 (0)