Skip to content

[Klaud Cold] Update Qwen3.5 FP8 MI355X SGLang AgentX MTP image to v0.5.22 / [Klaud Cold] 将 Qwen3.5 FP8 MI355X SGLang AgentX MTP 镜像更新至 v0.5.22 - #4519

Closed
Klaud-Cold wants to merge 31 commits into
mainfrom
klaud/auto-ebdcd9f3b9d57611-77ef7a85299ad744
Closed

Klaud-Cold wants to merge 31 commits into
mainfrom
klaud/auto-ebdcd9f3b9d57611-77ef7a85299ad744

Conversation

@Klaud-Cold

@Klaud-Cold Klaud-Cold commented Oct 25, 2026 •

Copy link
Copy Markdown
Collaborator

Goal: Update SGLang image from lmsysorg/sglang-rocm:v0.5.20-rocm720-mi35x-20260929 to lmsysorg/sglang:v0.5.22-rocm720-mi35x@sha256:c4b61360b251d62bb17da63f175d571ab22479eb46a144548d79f3ed3998ea11.
Baseline: 2026-10-01 · lmsysorg/sglang-rocm:v0.5.20-rocm720-mi35x-20260929
AgentX · TP4/EP1 · Mean latency · Sources: API 1, API 2, API 3, API 4

Concurrency Total tok/s/GPU ↑ Output tok/s/GPU ↑ TTFT ms ↓ TPOT ms ↓
1 3,937.4 44.04 570.78 2.99
4 6,208.56 68.9 641.47 3.47
8 10,231.88 99.91 758.7 3.87
12 17,032.96 153.62 893.45 4.51
14 20,252.82 182.93 906.43 4.68
16 21,949.56 190.69 983.06 5.01
18 25,799.76 217.33 1,038.01 5.25
20 27,750.74 229.76 996.06 5.56
22 29,989.99 247.43 1,088.26 5.7
24 32,314.81 266.47 1,118.73 6.17
28 35,777.41 309.75 1,204.35 8.15
32 37,312.33 327.54 1,259.23 7.4
36 40,015.69 365.15 1,249.08 8.03
40 42,063.01 396.87 1,452.96 9.03
48 46,144.62 459.86 1,534.1 11.03
56 50,584.21 537.03 1,718.54 13.7
64 56,681.91 600.06 1,996.43 16.91
72 59,009.37 653.23 2,216.89 19.38
80 59,233.15 654.01 3,115.43 24.02
Eval Score ↑ Samples
gsm8k/em_strict · c80 97.65% 1,319

Stop: Close this PR at any time to stop this candidate now; Klaud cancels its runs and deletes its branch.

中文

**目标:**将 SGLang 镜像从 lmsysorg/sglang-rocm:v0.5.20-rocm720-mi35x-20260929 更新为 lmsysorg/sglang:v0.5.22-rocm720-mi35x@sha256:c4b61360b251d62bb17da63f175d571ab22479eb46a144548d79f3ed3998ea11。
**基线:**2026-10-01 · lmsysorg/sglang-rocm:v0.5.20-rocm720-mi35x-20260929
AgentX · TP4/EP1 · 平均延迟 · 来源: API 1, API 2, API 3, API 4;数值及异常说明见上表。
**停止:**随时关闭此 PR 即可立即停止该候选:Klaud 会取消其运行并删除其分支。

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

Thanks for the contribution!

  • Review: If this PR changes files owned by someone other than a repository admin or @SemiAnalysisAI/core, ask one eligible CODEOWNER to complete the latest PR_REVIEW_CHECKLIST.md before contacting a core maintainer on Slack. Follow the template exactly, including As a PR reviewer and CODEOWNER, I have reviewed this and have, so sign-off verification triggers.
  • PR verification: Sweeps run only when the PR appends an inferencex-e2e/perf-changelog.yaml entry and carries exactly one primary label: full-sweep-fail-fast (strongly recommended; canary plus per-matrix fail-fast), full-sweep-enabled (canary; matrix jobs continue after a failure), or non-canary-full-sweep-enabled (no canary or fail-fast). The modifiers all-evals, evals-only, and agentx-fast require a primary label. On fork PRs, a maintainer applies the label. See sweep labels and reuse.
  • After merging: PR authors must ensure all GitHub Actions jobs pass. Transient failures often pass on rerun; see how to rerun failed jobs.
中文

感谢你的贡献!

  • **审阅:**如果 PR 修改的文件归属于仓库管理员及 @SemiAnalysisAI/core 之外的 CODEOWNER,请先联系一位有资格的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,再通过 Slack 联系核心维护者。必须严格遵循模板,并保留 As a PR reviewer and CODEOWNER, I have reviewed this and have,才能触发签核验证。
  • **PR 验证:**只有当 PR 在 inferencex-e2e/perf-changelog.yaml 末尾追加了条目,并且恰好带有一个主标签时,才会运行扫描:full-sweep-fail-fast(强烈推荐;canary 加逐矩阵 fail-fast)、full-sweep-enabled(有 canary;矩阵任务在失败后继续运行)或 non-canary-full-sweep-enabled(无 canary,也无 fail-fast)。修饰标签 all-evals、evals-only 和 agentx-fast 必须与主标签一起使用。fork PR 的标签由维护者添加。参见扫描标签与复用。
  • **合并后:**PR 作者必须确保所有 GitHub Actions 任务通过。临时性失败通常可以通过重新运行恢复;参见重新运行失败任务的说明。

@Klaud-Cold

Klaud-Cold commented Oct 25, 2026 •

Copy link
Copy Markdown
Collaborator Author

Initial attempt · Passed · Run 40230599415 / attempt 1 · 2026-10-25 21:59 UTC
lmsysorg/sglang:v0.5.22-rocm720-mi35x@sha256:c4b61360b251d62bb17da63f175d571ab22479eb46a144548d79f3ed3998ea11 · 88588aaf353a · AgentX · TP4/EP1 · Mean latency
Change: Image-only bump from SGLang main 98fce73d (sglang-rocm v0.5.20 20260929 build, AITER acf8fdf9) to the v0.5.22 release tag baa9befa (AITER e7d2453f); every recipe flag and env var still exists in v0.5.22 arg_groups with no renamed options, so recipe settings are unchanged.

Concurrency Output tok/s/GPU ↑ TTFT ms ↓ TPOT ms ↓
1 49.33 (+12%) 414.3 (-27.4%) 2.47 (-17.4%)
16 196.89 (+3.3%) 814.71 (-17.1%) 4.7 (-6.2%)
Eval Score ↑ Samples
gsm8k/em_strict · c80 97.95% (+0.30 pp) 1,319 each

Next: Smoke benchmarks and the c80 gsm8k eval passed on the measured head 1608875; append the perf-changelog entry and run the full-sweep-fail-fast final sweep.

中文

初次尝试 · 已通过 · Run 40230599415 / attempt 1 · 2026-10-25 21:59 UTC
lmsysorg/sglang:v0.5.22-rocm720-mi35x@sha256:c4b61360b251d62bb17da63f175d571ab22479eb46a144548d79f3ed3998ea11 · 88588aaf353a · AgentX · TP4/EP1 · 平均延迟
**变更:**仅更新镜像:从 SGLang main 98fce73d(sglang-rocm v0.5.20 20260929 构建,AITER acf8fdf9)更新到 v0.5.22 发布标签 baa9befa(AITER e7d2453f);所有 recipe 参数和环境变量在 v0.5.22 的 arg_groups 中仍然存在且未改名,因此 recipe 设置保持不变。实测数值及异常说明见上表。
**下一步:**冒烟基准测试和 c80 gsm8k 评测已在实测提交 1608875 上通过;追加 perf-changelog 条目并运行 full-sweep-fail-fast 最终扫描。

@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

parked · Session 1 is waiting on 40230599415. Recovery reruns preempted runs and starts the next session once they end.

中文

parked · 第 1 个会话正在等待 40230599415。恢复流程会重跑被抢占的运行,并在运行结束后启动下一个会话。

@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

resumed · The session ended before finishing; session 2 continues it in a new run of its planner.

中文

resumed · 会话未完成即已结束;第 2 个会话将在其规划运行的新运行中继续。

… MTP v0.5.22

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@Klaud-Cold Klaud-Cold added the full-sweep-fail-fast Full sweep with canary gate; first failure cancels the rest of that matrix (recommended) label Oct 25, 2026
@Klaud-Cold

Klaud-Cold commented Oct 25, 2026 •

Copy link
Copy Markdown
Collaborator Author

Final full sweep · Passed · Run 40238121355 / attempt 1 · 2026-10-26 02:33 UTC
lmsysorg/sglang:v0.5.22-rocm720-mi35x@sha256:c4b61360b251d62bb17da63f175d571ab22479eb46a144548d79f3ed3998ea11 · ed842865c96b · AgentX · TP4/EP1 · Mean latency
Change: Validate the complete updated-image family at this head.

Concurrency Output tok/s/GPU ↑ TTFT ms ↓ TPOT ms ↓
1 49.14 (+11.6%) 438.99 (-23.1%) 2.46 (-17.7%)
4 72.66 (+5.5%) 428.51 (-33.2%) 2.77 (-20.2%)
8 104.82 (+4.9%) 569.54 (-24.9%) 3.58 (-7.5%)
12 159.94 (+4.1%) 686.06 (-23.2%) 4.05 (-10.2%)
14 187.61 (+2.6%) 727.07 (-19.8%) 4.44 (-5.1%)
16 196.96 (+3.3%) 786.26 (-20%) 4.76 (-5%)
18 220.55 (+1.5%) 836.75 (-19.4%) 5.26 (+0.2%)
20 232.21 (+1.1%) 799.98 (-19.7%) 5.1 (-8.3%)
22 251.56 (+1.7%) 845.13 (-22.3%) 5.47 (-4%)
24 268.95 (+0.9%) 941.08 (-15.9%) 6.05 (-1.9%)
28 310.45 (+0.2%) 995.58 (-17.3%) 7.12 (-12.6%)
32 328.74 (+0.4%) 1,087.14 (-13.7%) 7.73 (+4.5%)
36 365.37 (+0.1%) 1,125.31 (-9.9%) 8.11 (+1%)
40 398.35 (+0.4%) 1,279.15 (-12%) 9.87 (+9.3%)
48 460.55 (+0.2%) 1,399.6 (-8.8%) 11.46 (+3.9%)
56 534.65 (-0.4%) 1,639.98 (-4.6%) 14.48 (+5.7%)
64 591.31 (-1.5%) 1,972.66 (-1.2%) 18.62 (+10.1%)
72 529.7 (-18.9%) 3,260.79 (+47.1%) 27.62 (+42.5%)
80 205.45 (-68.6%) 29,128.02 (+835%) 74.74 (+211.2%)
Eval Score ↑ Samples
gsm8k/em_strict · c80 97.65% (+0.00 pp) 1,319 each

Next: Mark ready for maintainer review.

中文

最终完整 sweep · 已通过 · Run 40238121355 / attempt 1 · 2026-10-26 02:33 UTC
lmsysorg/sglang:v0.5.22-rocm720-mi35x@sha256:c4b61360b251d62bb17da63f175d571ab22479eb46a144548d79f3ed3998ea11 · ed842865c96b · AgentX · TP4/EP1 · 平均延迟
**变更:**验证此提交更新镜像后的完整配置族。实测数值及异常说明见上表。
**下一步:**标记为就绪,等待维护者审查。

@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

parked · Session 2 is waiting on 40238121355. Recovery reruns preempted runs and starts the next session once they end.

中文

parked · 第 2 个会话正在等待 40238121355。恢复流程会重跑被抢占的运行,并在运行结束后启动下一个会话。

@github-actions

Copy link
Copy Markdown
Contributor

@Klaud-Cold
Klaud-Cold marked this pull request as ready for review October 26, 2026 02:33
@Klaud-Cold
Klaud-Cold requested a review from a team October 26, 2026 02:33
@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

validated · Repairs: unknown · Runs: 40230599415, 40238085593, 40238121355
All owned runs ended. Full sweep verified; ready for review.

中文

validated · 修复次数:未知 · 运行:40230599415, 40238085593, 40238121355
所有自有运行均已结束。完整 sweep 已验证;已就绪,等待审查。

@claude claude Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code review found no issues

No high-confidence issues detected in this change.

@github-actions github-actions Bot added the klaud-finished Klaud verified the full sweep; ready for review label Oct 26, 2026
@Klaud-Cold Klaud-Cold added the klaud-requeue Closed so Klaud re-plans the family; no maintainer hold label Nov 9, 2026
@Klaud-Cold

Copy link
Copy Markdown
Collaborator Author

requeued · Open for over 5 days while the published baseline of this family moved to a newer image. Closed with klaud-requeue so a new candidate can refresh the family from its current image.

中文

requeued · 本 PR 已开放超过 5 天,而该配置族已发布的基线已更新为更新的镜像。已关闭并标记 klaud-requeue,新的候选可以基于当前镜像更新该配置族。

@Klaud-Cold Klaud-Cold closed this Nov 9, 2026
@Klaud-Cold
Klaud-Cold deleted the klaud/auto-ebdcd9f3b9d57611-77ef7a85299ad744 branch November 9, 2026 04:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

full-sweep-fail-fast Full sweep with canary gate; first failure cancels the rest of that matrix (recommended) klaud-finished Klaud verified the full sweep; ready for review klaud-requeue Closed so Klaud re-plans the family; no maintainer hold

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

1 participant