[Klaud-Cold]

Goal: Update SGLang image from lmsysorg/sglang-rocm:v0.5.20-rocm720-mi35x-20260927 to lmsysorg/sglang:v0.5.22-rocm720-mi35x@sha256:c4b61360b251d62bb17da63f175d571ab22479eb46a144548d79f3ed3998ea11.
Baseline: 2026-09-29 · lmsysorg/sglang-rocm:v0.5.20-rocm720-mi35x-20260927
Mean latency · Sources: API 1, API 2, API 3, API 4

Point	Total tok/s/GPU ↑	Output tok/s/GPU ↑	TTFT ms ↓	TPOT ms ↓
AgentX c1 TP2 EP1 3fce3f	8,002.63	89.04	587.28	2.89
AgentX c1 TP4 EP1 3b2d8f	4,568.73	49.37	511.59	2.33
AgentX c4 TP2 EP1 5ed0ee	12,426.08	138.1	635.85	3.41
AgentX c4 TP4 EP1 c004ae	6,399.73	72.5	517.87	2.57
AgentX c8 TP2 EP1 a862de	20,430.51	199.86	867.71	4.28
AgentX c8 TP4 EP1 f9b76e	10,566.18	104.71	673.11	3.05
AgentX c12 TP2 EP1 314e97	32,814.57	297.55	1,148.79	5.33
AgentX c12 TP4 EP1 bc5d60	17,328.01	153.27	714.62	3.09
AgentX c16 TP2 EP1 22bcfb	42,459.72	371.64	1,162.62	5.88
AgentX c16 TP4 EP1 13ae22	23,334.75	202.36	861	3.96
AgentX c20 TP2 EP1 1b2709	52,805.39	442.85	1,324.52	6.38
AgentX c24 TP2 EP1 6d7cb3	61,212.81	513.19	1,479.5	7.61
AgentX c28 TP2 EP1 50f3d7	68,173.42	565.18	1,549.09	9.05
AgentX c32 TP2 EP1 694075	70,494.75	619.06	1,722.19	9.61
AgentX c36 TP2 EP1 45a526	75,862.53	681.61	1,738.96	11.48
AgentX c40 TP2 EP1 ee7823	79,526.35	736.55	1,895.68	11.1

Eval	Score ↑	Samples
gsm8k/em_strict · c40	97.19%	1,319

Stop: Close this PR at any time to stop this candidate now; Klaud cancels its runs and deletes its branch.

中文

**目标：**将 SGLang 镜像从 lmsysorg/sglang-rocm:v0.5.20-rocm720-mi35x-20260927 更新至 lmsysorg/sglang:v0.5.22-rocm720-mi35x@sha256:c4b61360b251d62bb17da63f175d571ab22479eb46a144548d79f3ed3998ea11。
**基线：**2026-09-29 · lmsysorg/sglang-rocm:v0.5.20-rocm720-mi35x-20260927
平均延迟 · 来源： API 1, API 2, API 3, API 4；数值及异常说明见上表。
**停止：**随时关闭此 PR 即可立即停止该候选：Klaud 会取消其运行并删除其分支。

[github-actions]

Thanks for the contribution!

• Review: If this PR changes files owned by someone other than a repository admin or @SemiAnalysisAI/core, ask one eligible CODEOWNER to complete the latest PR_REVIEW_CHECKLIST.md before contacting a core maintainer on Slack. Follow the template exactly, including As a PR reviewer and CODEOWNER, I have reviewed this and have, so sign-off verification triggers.
• PR verification: Sweeps run only when the PR appends an inferencex-e2e/perf-changelog.yaml entry and carries exactly one primary label: full-sweep-fail-fast (strongly recommended; canary plus per-matrix fail-fast), full-sweep-enabled (canary; matrix jobs continue after a failure), or non-canary-full-sweep-enabled (no canary or fail-fast). The modifiers all-evals, evals-only, and agentx-fast require a primary label. On fork PRs, a maintainer applies the label. See sweep labels and reuse.
• After merging: PR authors must ensure all GitHub Actions jobs pass. Transient failures often pass on rerun; see how to rerun failed jobs.

中文

感谢你的贡献！

• **审阅：**如果 PR 修改的文件归属于仓库管理员及 @SemiAnalysisAI/core 之外的 CODEOWNER，请先联系一位有资格的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md，再通过 Slack 联系核心维护者。必须严格遵循模板，并保留 As a PR reviewer and CODEOWNER, I have reviewed this and have，才能触发签核验证。
• **PR 验证：**只有当 PR 在 inferencex-e2e/perf-changelog.yaml 末尾追加了条目，并且恰好带有一个主标签时，才会运行扫描：full-sweep-fail-fast（强烈推荐；canary 加逐矩阵 fail-fast）、full-sweep-enabled（有 canary；矩阵任务在失败后继续运行）或 non-canary-full-sweep-enabled（无 canary，也无 fail-fast）。修饰标签 all-evals、evals-only 和 agentx-fast 必须与主标签一起使用。fork PR 的标签由维护者添加。参见扫描标签与复用。
• **合并后：**PR 作者必须确保所有 GitHub Actions 任务通过。临时性失败通常可以通过重新运行恢复；参见重新运行失败任务的说明。

[Klaud-Cold]

Initial attempt · Passed · Run 40503498331 / attempt 1 · 2026-10-27 14:48 UTC
lmsysorg/sglang:v0.5.22-rocm720-mi35x@sha256:c4b61360b251d62bb17da63f175d571ab22479eb46a144548d79f3ed3998ea11 · ccd4fcd15796 · Mean latency
Change: Image only: SGLang a0ba1968b1 (main, 0.5.20.dev20260927, AITER acf8fdf9) to release tag v0.5.22 (baa9befa38, AITER e7d2453f, MoRI f39fa765); every recipe flag, choice value and env var used is still defined in v0.5.22 (sgl-project/sglang compare a0ba1968b1...v0.5.22), while HiCache/Mamba/MTP paths changed materially (#40223, #36345, #42553), so HiCache points carry the most risk.

Point	Output tok/s/GPU ↑	TTFT ms ↓	TPOT ms ↓
AgentX c1 TP4 EP1 3b2d8f	52.49 (+6.3%)	368.21 (-28%)	2.05 (-12%)
AgentX c1 TP2 EP1 3fce3f	95.25 (+7%)	453.69 (-22.7%)	2.73 (-5.5%)
AgentX c16 TP2 EP1 22bcfb	378.88 (+1.9%)	909.99 (-21.7%)	5.8 (-1.4%)

Eval	Score ↑	Samples
gsm8k/em_strict · c40	97.35% (+0.15 pp)	1,319 each

Next: Smoke benchmarks and the gsm8k eval passed, so append the perf-changelog entry and run the full-sweep-fail-fast final sweep over all 16 points.

中文

初次尝试 · 已通过 · Run 40503498331 / attempt 1 · 2026-10-27 14:48 UTC
lmsysorg/sglang:v0.5.22-rocm720-mi35x@sha256:c4b61360b251d62bb17da63f175d571ab22479eb46a144548d79f3ed3998ea11 · ccd4fcd15796 · 平均延迟
**变更：**仅更换镜像：SGLang 从 a0ba1968b1（main，0.5.20.dev20260927，AITER acf8fdf9）更新到发布标签 v0.5.22（baa9befa38，AITER e7d2453f，MoRI f39fa765）；配方使用的所有参数、取值和环境变量在 v0.5.22 中仍然存在（sgl-project/sglang compare a0ba1968b1...v0.5.22），但 HiCache/Mamba/MTP 路径有较大改动（#40223、#36345、#42553），因此 HiCache 点风险最高。实测数值及异常说明见上表。
**下一步：**smoke 基准测试和 gsm8k 评测均已通过，因此追加 perf-changelog 条目，并以 full-sweep-fail-fast 对全部 16 个点运行最终扫描。

[Klaud-Cold]

parked · Session 1 is waiting on 40503498331. Recovery reruns preempted runs and starts the next session once they end.

中文

parked · 第 1 个会话正在等待 40503498331。恢复流程会重跑被抢占的运行，并在运行结束后启动下一个会话。

[Klaud-Cold]

resumed · The session ended before finishing; session 2 continues it in a new run of its planner.

中文

resumed · 会话未完成即已结束；第 2 个会话将在其规划运行的新运行中继续。

[Klaud-Cold]

Final full sweep · Running · Run 40524758865 / attempt 1 · 2026-10-27 14:49 UTC
lmsysorg/sglang:v0.5.22-rocm720-mi35x@sha256:c4b61360b251d62bb17da63f175d571ab22479eb46a144548d79f3ed3998ea11 · a2a763470957
Change: Append the perf-changelog entry for the v0.5.22 image (agentic-coding only); recipe unchanged from the passed smoke attempt.

Next: Wait for the full-sweep-fail-fast final sweep to cover all 16 AgentX points and the c40 gsm8k eval.

中文

最终完整 sweep · 运行中 · Run 40524758865 / attempt 1 · 2026-10-27 14:49 UTC
lmsysorg/sglang:v0.5.22-rocm720-mi35x@sha256:c4b61360b251d62bb17da63f175d571ab22479eb46a144548d79f3ed3998ea11 · a2a763470957
**变更：**为 v0.5.22 镜像追加 perf-changelog 条目（仅 agentic-coding）；配方与已通过的 smoke 尝试相同。
**下一步：**等待 full-sweep-fail-fast 最终扫描覆盖全部 16 个 AgentX 点和 c40 gsm8k 评测。

[Klaud-Cold]

parked · Session 2 is waiting on 40524758865. Recovery reruns preempted runs and starts the next session once they end.

中文

parked · 第 2 个会话正在等待 40524758865。恢复流程会重跑被抢占的运行，并在运行结束后启动下一个会话。

[github-actions]

View unofficial run (performance): https://inferencex.semianalysis.com/inference?unofficialRun=40524758865

View unofficial run (accuracy): https://inferencex.semianalysis.com/evaluation?unofficialRun=40524758865

[Klaud-Cold]

Final full sweep · Passed · Run 40524758865 / attempt 5 · 2026-10-30 01:26 UTC
lmsysorg/sglang:v0.5.22-rocm720-mi35x@sha256:c4b61360b251d62bb17da63f175d571ab22479eb46a144548d79f3ed3998ea11 · a2a763470957 · Mean latency
Change: Validate the complete updated-image family at this head.

Point	Output tok/s/GPU ↑	TTFT ms ↓	TPOT ms ↓
AgentX c1 TP2 EP1 3fce3f	95.32 (+7%)	470.29 (-19.9%)	2.71 (-6.2%)
AgentX c1 TP4 EP1 3b2d8f	53.05 (+7.4%)	371.42 (-27.4%)	2.05 (-12%)
AgentX c4 TP2 EP1 5ed0ee	142.26 (+3%)	515.03 (-19%)	3.13 (-8.2%)
AgentX c4 TP4 EP1 c004ae	75.64 (+4.3%)	401.85 (-22.4%)	2.31 (-10.1%)
AgentX c8 TP2 EP1 a862de	203.9 (+2%)	682.19 (-21.4%)	4.27 (-0.2%)
AgentX c8 TP4 EP1 f9b76e	111.14 (+6.1%)	481.19 (-28.5%)	2.6 (-14.8%)
AgentX c12 TP2 EP1 314e97	304.69 (+2.4%)	884 (-23%)	5.43 (+1.9%)
AgentX c12 TP4 EP1 bc5d60	163.43 (+6.6%)	584.25 (-18.2%)	3.31 (+7.1%)
AgentX c16 TP2 EP1 22bcfb	378.42 (+1.8%)	897.9 (-22.8%)	5.85 (-0.5%)
AgentX c16 TP4 EP1 13ae22	206.07 (+1.8%)	672.71 (-21.9%)	3.56 (-10.1%)
AgentX c20 TP2 EP1 1b2709	451.2 (+1.9%)	1,017.76 (-23.2%)	6.57 (+3%)
AgentX c24 TP2 EP1 6d7cb3	519.8 (+1.3%)	1,140.74 (-22.9%)	7.96 (+4.6%)
AgentX c28 TP2 EP1 50f3d7	574.14 (+1.6%)	1,255.89 (-18.9%)	8.74 (-3.4%)
AgentX c32 TP2 EP1 694075	624.13 (+0.8%)	1,323.89 (-23.1%)	10.3 (+7.2%)
AgentX c36 TP2 EP1 45a526	687.18 (+0.8%)	1,347.41 (-22.5%)	10.23 (-10.9%)
AgentX c40 TP2 EP1 ee7823	744.23 (+1%)	1,476.19 (-22.1%)	11.58 (+4.3%)

Eval	Score ↑	Samples
gsm8k/em_strict · c40	97.42% (+0.23 pp)	1,319 each

Next: Mark ready for maintainer review.

中文

最终完整 sweep · 已通过 · Run 40524758865 / attempt 5 · 2026-10-30 01:26 UTC
lmsysorg/sglang:v0.5.22-rocm720-mi35x@sha256:c4b61360b251d62bb17da63f175d571ab22479eb46a144548d79f3ed3998ea11 · a2a763470957 · 平均延迟
**变更：**验证此提交更新镜像后的完整配置族。实测数值及异常说明见上表。
**下一步：**标记为就绪，等待维护者审查。

[Klaud-Cold]

/use 40524758865

[Klaud-Cold]

validated · Repairs: unknown · Runs: 40503498331, 40524703267, 40524758865
All owned runs ended. Full sweep verified; ready for review.

中文

validated · 修复次数：未知 · 运行：40503498331, 40524703267, 40524758865
所有自有运行均已结束。完整 sweep 已验证；已就绪，等待审查。

[github-actions]

@Klaud-Cold staged run 40524758865.

• Qwen-3.5-397B-A17B · agentic-traces · FP4 · mi355x_sglang · 2026-10-27

This run remains available across future /stage-results requests. Staging the same run ID again updates its staged data. Staging workflow

[claude]

Code review found no issues

No high-confidence issues detected in this change.