File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -43,6 +43,7 @@ The performance data includes:
4343| System | #-GPUs | Precision | GBS | MBS | Sequence Length | TP | PP | CP | VP | EP | Tokens / sec / GPU | Model TFLOP / sec / GPU |
4444| --------| --------| -----------| -----| -----| -----------------| ----| ----| ----| ----| ----| -----------------------| -------------------------|
4545| DGX-GB300 | 256 | MXFP8 | 4096 | 1 | 4096 | 1 | 2 | 1 | 8 | 32 | 6288 | 1636 |
46+ | DGX-GB300 | 256 | NVFP4 | 4096 | 1 | 4096 | 1 | 2 | 1 | 8 | 32 | 6640 | 1728 |
4647| DGX-GB200 | 256 | MXFP8 | 4096 | 1 | 4096 | 1 | 4 | 1 | 4 | 64 | 4912 | 1277 |
4748
4849#### Model: DeepSeekV4 Flash
@@ -73,7 +74,9 @@ The performance data includes:
7374| System | #-GPUs | Precision | GBS | MBS | Sequence Length | TP | PP | CP | VP | EP | Tokens / sec / GPU | Model TFLOP / sec / GPU |
7475| --------| --------| -----------| -----| -----| -----------------| ----| ----| ----| ----| ----| -----------------------| -------------------------|
7576| DGX-GB300 | 256 | MXFP8 | 8192 | 2 | 4096 | 1 | 4 | 1 | 12 | 32 | 8832 | 1306 |
77+ | DGX-GB300 | 256 | NVFP4 | 8192 | 2 | 4096 | 1 | 4 | 1 | 12 | 32 | 9216 | 1365 |
7678| DGX-GB200 | 256 | MXFP8 | 8192 | 1 | 4096 | 1 | 8 | 1 | 3 | 32 | 7264 | 1076 |
79+ | DGX-GB200 | 256 | NVFP4 | 8192 | 1 | 4096 | 1 | 8 | 1 | 3 | 32 | 8000 | 1185 |
7780
7881#### Model: Nemotron_3_5_Lightning
7982
You can’t perform that action at this time.
0 commit comments