Repository navigation
Commit a5db3a3
committed
feat(agentx): run GLM-5.2 FP4 MI355X ATOM TP8 C1/C2 on mono decode
Track the TP8 recipe that ROCm/ATOM PR 2736 adds to
recipes/Agentic-GLM-5.2.md, on rocm/atom-dev:nightly_202610271459
(ATOM 06dbf6692), the first nightly that contains it.
- TP8 C1/C2 run the GLM-5.2 mono decode (ATOM_MONO_ENABLE=1) at 3 draft
tokens (AL 2.99), max-num-seqs equal to CONC, graphs [1] and [1,2]: the
TP4 C1/C2 command with -tp 8. TP8 C4 and every TP4/DCP4 point keep their
settings and rerun only for the image.
- The atomesh router digest moves to the same nightly (5332ae78).
中文:按 ROCm/ATOM PR 2736 加入 recipes/Agentic-GLM-5.2.md 的 TP8 配方更新
MI355X ATOM AgentX 配置,镜像换为首个包含该 PR 的
rocm/atom-dev:nightly_202610271459(ATOM 06dbf6692)。TP8 C1/C2 使用
GLM-5.2 mono decode(ATOM_MONO_ENABLE=1),3 个 draft token(AL 2.99),
max-num-seqs 等于并发数,graph 为 [1] 和 [1,2],即 TP4 C1/C2 命令改为
-tp 8。TP8 C4 及所有 TP4/DCP4 点位设置不变,只因换镜像而重跑。atomesh
router digest 同步为同一 nightly(5332ae78)。
Signed-off-by: zhuyuhua-v <yuhzhu@amd.com>1 parent d1cb286 commit a5db3a3
3 files changed
Lines changed: 28 additions & 12 deletions
File tree
- inferencex-e2e
- benchmarks/single_node/srt-slurm-recipes/glm5.2/atom/mi355x-fp4-mtp
- configs
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
6 | 6 | | |
7 | 7 | | |
8 | 8 | | |
9 | | - | |
| 9 | + | |
10 | 10 | | |
11 | 11 | | |
12 | 12 | | |
| |||
33 | 33 | | |
34 | 34 | | |
35 | 35 | | |
36 | | - | |
| 36 | + | |
37 | 37 | | |
38 | 38 | | |
39 | 39 | | |
40 | 40 | | |
41 | 41 | | |
42 | 42 | | |
43 | | - | |
44 | | - | |
| 43 | + | |
| 44 | + | |
45 | 45 | | |
46 | 46 | | |
47 | 47 | | |
| |||
210 | 210 | | |
211 | 211 | | |
212 | 212 | | |
213 | | - | |
214 | | - | |
215 | | - | |
| 213 | + | |
| 214 | + | |
| 215 | + | |
| 216 | + | |
| 217 | + | |
216 | 218 | | |
217 | 219 | | |
218 | 220 | | |
| |||
222 | 224 | | |
223 | 225 | | |
224 | 226 | | |
225 | | - | |
226 | | - | |
227 | | - | |
| 227 | + | |
| 228 | + | |
| 229 | + | |
| 230 | + | |
| 231 | + | |
228 | 232 | | |
229 | 233 | | |
230 | 234 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1495 | 1495 | | |
1496 | 1496 | | |
1497 | 1497 | | |
1498 | | - | |
| 1498 | + | |
| 1499 | + | |
1499 | 1500 | | |
1500 | | - | |
| 1501 | + | |
1501 | 1502 | | |
1502 | 1503 | | |
1503 | 1504 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
11556 | 11556 | | |
11557 | 11557 | | |
11558 | 11558 | | |
| 11559 | + | |
| 11560 | + | |
| 11561 | + | |
| 11562 | + | |
| 11563 | + | |
| 11564 | + | |
| 11565 | + | |
| 11566 | + | |
| 11567 | + | |
| 11568 | + | |
| 11569 | + | |
0 commit comments