Repository navigation
[PowerX] collect AMD multinode power with the native exporter / [PowerX] 用原生 exporter 采集 AMD 多节点功耗 - #4820
Merged
Conversation
…re it has no DCGM port
…ts and assert native AMD telemetry
Contributor
|
Thanks for the contribution!
中文感谢你的贡献!
|
Contributor
|
Generally most InferenceX submissions don't need to add changes to the infx package. On the off chance they do, generally the diff is small. Please prompt your agent to clean your PR to keep your diff to only necessary & minimal changes too. We have an increased code quality bar for changes to the infx package. 中文大多数 InferenceX 提交通常不需要修改 infx 包。即使确实需要,改动通常也很小。请让你的 agent 清理 PR,使改动只包含必要且最小的内容。infx 包的改动有更高的代码质量要求。 |
This was referenced Nov 6, 2026
Open
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Multinode points on clusters without a DCGM exporter port now measure GPU power with the cluster's own exporter. Only mi355x-amds changes: its disaggregated and TileRT points get best-effort AMD GPU and RAPL CPU power.
runners.yamlnow rejects RAPL on shared nodes. No config key changes, so no changelog entry.Testing: Unit tests pass; 19 of 1388 rendered recipes change, all mi355x multinode. MI355X proof has valid GPU and CPU power. TP4-prefill variants idle some GPUs, so their power is invalid; results stay.
Depends on: #3670.
AI model disclosure
PR checklist and change type
Type of Change
Checklist
python -m infx.matrix.changed --base origin/mainlists affected config keys, I have appended one new entry covering them to the physical end ofinferencex-e2e/perf-changelog.yaml; if it lists none, I have added none. I have not edited historical entriesinferencex-e2e/perf-changelog.yamlentry, it carries exactly one primary sweep label (a maintainer applies it on fork PRs):full-sweep-fail-fast(recommended),full-sweep-enabled, ornon-canary-full-sweep-enabled. Optional modifiersall-evals,evals-only, andagentx-fastrequire a primary label; the last two block reuse while applied.OWNER/MEMBER/COLLABORATOR) has commented/use <run_id>(or the legacy/reuse-sweep-run) on this PR. Do this only once there is a final full sweep that is all green with evals passing, since after this comment the primary sweep label will no longer automatically kick off new sweeps. Remove and re-add the primary sweep label to force a new sweep.中文
没有 DCGM exporter 端口的集群,多节点点现在用集群自带的 exporter 采集 GPU 功耗。目前只有 mi355x-amds 受影响:它的 disagg 和 TileRT 点默认采集 AMD GPU 与 RAPL CPU 功耗(best-effort)。
runners.yaml现在拒绝在共享节点上配置 RAPL。没有配置 key 变化,因此不新增 changelog 条目。测试: 单元测试通过;1388 个渲染出的 recipe 中只有 19 个 mi355x 多节点 recipe 变化。MI355X 验证 run 的 GPU 功耗和 RAPL CPU 功耗均有效。TP4 prefill 变体有空闲 GPU,功耗会判为无效,但基准测试结果保留。
依赖: #3670。
AI 模型:claude-opus-5-5(Claude Opus 5.5),负责实现、测试、文档和 PR 文字。