Repository navigation
[PowerX] collect Qwen3.5 FP8 B300 Dynamo-SGLang AgentX power / [PowerX] 采集 Qwen3.5 FP8 B300 Dynamo-SGLang AgentX 功耗 - #4413
Conversation
中文:将 Qwen3.5 FP8 B300 SGLang 镜像更新至 v0.5.22。
|
Thanks for the contribution!
中文感谢你的贡献!
|
f6cbf01 to
fcb8706
Compare
There was a problem hiding this comment.
I reviewed this PR and didn't find any bugs. Because nvidia-master.yaml has designated code owners, a human look is still worthwhile. One small thing before merge: the new changelog entry's pr-link still ends in pull/XXX, so it should be changed to this PR's number.
What was reviewed:
- The new tag and digest for
qwen3.5-fp8-b300-sglangare identical to thev0.5.22-cu130pin already used byqwen3.5-fp8-b300-sglang-mtpand about 15 other entries in the file. - The changelog block is appended at the physical end, and no earlier bytes changed. It covers the one affected key and is in English.
- The missing
scenario-typeis consistent with earlier entries for this key (PRs 1048, 1451 and 4059), none of which set it.
Extended reasoning...
This change bumps one container image (tag plus sha256 digest) for the qwen3.5-fp8-b300-sglang benchmark config and appends one matching perf-changelog entry. It touches no security-sensitive surface. The new digest matches pins that already run elsewhere in the same file. The PR still needs human review because CODEOWNERS assigns named reviewers to inferencex-e2e/configs/nvidia-master.yaml, and the changelog pr-link is still a placeholder.
This review covers commit f6cbf01, which is no longer the latest commit on this pull request; later commits are not covered by it.
中文:让 Qwen3.5 FP8 B300 SGLang 的 TP4 从并发 1 开始。
|
View unofficial run (performance): https://inferencex.semianalysis.com/inference?unofficialRun=42278372774 View unofficial run (accuracy): https://inferencex.semianalysis.com/evaluation?unofficialRun=42278372774 |
[skip-sweep]
|
/use 42278372774 |
|
@edwingao28 staging run 42278372774. InferenceX-app staging workflow is now running. Existing staged runs will be preserved; this comment will be updated when staging completes. |
[skip-sweep]
[skip-sweep]
[skip-sweep]
[skip-sweep]
|
Ingest report — ✅ Results ingested into the Ingest workflow · Merge Ingest run · Benchmark source run
benchmarkFiles 10, rawBenchmarkRows 18, coveredByPerJobFiles 9, purgedPoints 0, failedRunRows 0, runStatsNew 0, runStatsDuplicate 0, evalSamplesNew 9233, gpuMetricSamplesNew 266196, powerPublicationPoints 9, changelogEntriesWritten 1 Counts cover only this run. Rows: benchmark_results, eval_results, agentic rows linked to a trace, gpu_metrics series. This comment updates if the ingest is rerun. 中文Ingest 报告 — ✅ 结果已写入 上表仅统计本次运行写入的数据,各行单位依次为 benchmark_results 行、eval_results 行、已关联 trace 的 agentic 行和 gpu_metrics 序列。重新运行 ingest 时本评论会原地更新。 |
Summary
Qwen3.5 FP8 B300 Dynamo-SGLang AgentX publishes no measured power. Its curve (
qwen3.5-fp8-b300-dynamo-sglang-agentic-disagg, 2026-10-21) has valid power on 0 / 9 points. The curve predates default-on multinode power collection (#3670).This PR originally updated the Qwen3.5 FP8 B300 SGLang 8k1k config. #4697 retired every Qwen3.5 8k1k config, so the PR now reruns this AgentX curve to collect power.
Changes:
inferencex-e2e/perf-changelog.yaml: append one block listingqwen3.5-fp8-b300-dynamo-sglang-agentic-disagg. It is the only key of its curve, so the rerun replaces the curve whole.infx.matrix.changedlists no keys.qwen3.5-fp4-b300-dynamo-sglang-agentic-pareto) is not rerun, because the Qwen3.5 NVFP4 weights are missing onb300-dsxe.Testing:
curve_coverage.py: no dashboard point lost (9 published points, 9 in the run).validate_perf_changelog --base-ref origin/mainpasses after the main sync.Curve change after publishing:
Limits:
b300-dsxedeclares no CPU power exporter.PR checklist and change type
Type of Change
Checklist
python -m infx.matrix.changed --base origin/mainlists affected config keys, I have appended one new entry covering them to the physical end ofinferencex-e2e/perf-changelog.yaml; if it lists none, I have added none. I have not edited historical entriesinferencex-e2e/perf-changelog.yamlentry, it carries exactly one primary sweep label (a maintainer applies it on fork PRs):full-sweep-fail-fast(recommended),full-sweep-enabled, ornon-canary-full-sweep-enabled. Optional modifiersall-evals,evals-only, andagentx-fastrequire a primary label; the last two block reuse while applied.OWNER/MEMBER/COLLABORATOR) has commented/use <run_id>(or the legacy/reuse-sweep-run) on this PR. Do this only once there is a final full sweep that is all green with evals passing, since after this comment the primary sweep label will no longer automatically kick off new sweeps. Remove and re-add the primary sweep label to force a new sweep.