Skip to content

Commit c03966a

Browse files
committed
chore(skills): reduce expert overlap baseline leakage
Signed-off-by: Chen Cui <chcui@nvidia.com>
1 parent ee5f833 commit c03966a

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

  • skills/nemo-mbridge-perf-expert-parallel-overlap/evals

‎skills/nemo-mbridge-perf-expert-parallel-overlap/evals/evals.json‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
[
22
{
33
"id": "expert-parallel-overlap-positive-alltoall-smoke",
4-
"question": "In Megatron Bridge, I want to reproduce the correctness-first alltoall expert-parallel overlap benchmark without flex dispatch or delayed wgrad. Name the benchmark shape, the exact overrides to enable only plain EP overlap, the flag I must not use, and the steady-window timing comparison.",
4+
"question": "In Megatron Bridge, my 16x H100 Qwen3-30B-A3B MoE run is dispatch-bound and I want to isolate only expert all-to-all overlap, without flex dispatch or delayed wgrad. Which exact toggles should I set, which convenience flag should I avoid, and what speedup was measured in the short run?",
55
"expected_skill": "nemo-mbridge-perf-expert-parallel-overlap",
66
"expected_script": null,
77
"ground_truth": "The answer should use the expert-parallel overlap skill and focus on the plain alltoall benchmark. It should state the benchmark shape: Qwen3 MoE 30B-A3B SFT, 16 H100 GPUs, EP=16, alltoall, BF16, global batch size 1024, CUDA graphs disabled, moe_permute_fusion=false, with iterations 3-8 as the steady window. It should enable plain EP overlap with --cuda_graph_impl none, --moe_flex_dispatcher_backend None, --moe_a2a_overlap false, comm_overlap.overlap_moe_expert_parallel_comm=true, comm_overlap.delay_wgrad_compute=false, and model.moe_shared_expert_overlap=false. It should warn not to use --moe_a2a_overlap true for this isolation test because the helper enables both overlap_moe_expert_parallel_comm and delay_wgrad_compute. It should quote the timing comparison: no EP overlap 41.25s (1.000x), EP overlap 31.31s (1.317x), EP overlap plus delay_wgrad_compute 31.20s (1.322x), and say delayed wgrad did not show a meaningful independent win in this benchmark.",

0 commit comments

Comments
 (0)