Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions inferencex-e2e/configs/nvidia-master.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5648,6 +5648,7 @@ kimik3-fp4-gb300-dynamo-vllm-agentic-dspark-mooncake-dcp8-disagg:
srt-recipe: disagg-variants.yaml:override_1p3d_specdecode
eval-srt-recipe: disagg-variants.yaml:override_1p3d_specdecode_eval
power: true
cpu-power: true
prefill:
num-worker: 1
tp: 8
Expand All @@ -5671,6 +5672,7 @@ kimik3-fp4-gb300-dynamo-vllm-agentic-dspark-mooncake-dcp8-disagg:
srt-recipe: disagg-variants.yaml:override_1p2d_specdecode
eval-srt-recipe: disagg-variants.yaml:override_1p2d_specdecode_eval
power: true
cpu-power: true
prefill:
num-worker: 1
tp: 8
Expand All @@ -5694,6 +5696,7 @@ kimik3-fp4-gb300-dynamo-vllm-agentic-dspark-mooncake-dcp8-disagg:
srt-recipe: disagg-variants.yaml:override_1p2d_cap128
eval-srt-recipe: disagg-variants.yaml:override_1p2d_cap128_eval
power: true
cpu-power: true
prefill:
num-worker: 1
tp: 8
Expand All @@ -5716,6 +5719,7 @@ kimik3-fp4-gb300-dynamo-vllm-agentic-dspark-mooncake-dcp8-disagg:
srt-recipe: disagg-variants.yaml:override_3p4d_cap128
eval-srt-recipe: disagg-variants.yaml:override_3p4d_cap128_eval
power: true
cpu-power: true
prefill:
num-worker: 3
tp: 8
Expand All @@ -5738,6 +5742,7 @@ kimik3-fp4-gb300-dynamo-vllm-agentic-dspark-mooncake-dcp8-disagg:
srt-recipe: disagg-variants.yaml:override_2p3d_cap128
eval-srt-recipe: disagg-variants.yaml:override_2p3d_cap128_eval
power: true
cpu-power: true
prefill:
num-worker: 2
tp: 8
Expand Down Expand Up @@ -5780,6 +5785,7 @@ kimik3-fp4-gb300-dynamo-vllm-agentic-dspark-mooncake-dep16-disagg:
srt-recipe: disagg-tp8-dep16.yaml:override_3p1d_c336
eval-srt-recipe: disagg-tp8-dep16.yaml:override_3p1d_c336_eval
power: true
cpu-power: true
prefill:
num-worker: 3
tp: 8
Expand Down
11 changes: 11 additions & 0 deletions inferencex-e2e/perf-changelog.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -11971,3 +11971,14 @@
- "Collect Grace CPU power on the Kimi K3 GB300 aggregate AgentX recipe, with cpu-power-exporter v2.66.1."
- "Publish CPU socket, rail, SysIO and module power over the GPU window, independent of the GPU verdict, and per-host GPU power in workers[]."
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/3296

- config-keys:
- kimik3-fp4-gb300-dynamo-vllm-agentic-dspark-mooncake-dcp8-disagg
- kimik3-fp4-gb300-dynamo-vllm-agentic-dspark-mooncake-dep16-disagg
- kimik3-fp4-gb300-dynamo-vllm-agentic-dspark-mooncake-dcp8-agg
scenario-type:
- agentic-coding
description:
- "Collect Grace CPU power on the disaggregated Kimi K3 GB300 AgentX recipes and rerun the full curve, so every point carries GPU and CPU power."
- "Restores the 8 disaggregated points that the aggregate-only run of #3296 replaced on the dashboard."
pr-link: https://github.com/SemiAnalysisAI/InferenceX/pull/4773
Loading