Skip to content

CI: Update baseline.json (from PR #376) - #377

Open
MingxuZh wants to merge 1 commit into
mainfrom
ci/update-baseline-pr-376
Open

CI: Update baseline.json (from PR #376) #377
MingxuZh wants to merge 1 commit into
mainfrom
ci/update-baseline-pr-376

Conversation

@MingxuZh

@MingxuZh MingxuZh commented Aug 6, 2026

Copy link
Copy Markdown
Collaborator

Fused MoE Benchmark Comparison

Ratio = log / baseline (lower is better)

LOWER (log < baseline)

num_tokens - num_experts - topk - hidden_size - shard_intermediate_size log baseline ratio
fused_moe:1-32-4-2880-2880-torch.bfloat16-False-silu 0.317 0.321984 -1.68%
fused_moe:1-32-4-2880-2880-torch.bfloat16-True-silu 0.322 0.325 -0.96%
fused_moe:1-64-6-1280-1792-torch.bfloat16-False-silu 0.180 0.188084 -4.05%
fused_moe:1-64-6-1280-1792-torch.bfloat16-True-silu 0.185 0.194532 -4.93%
fused_moe:1-64-8-3584-1280-torch.bfloat16-False-silu 0.333 0.343252 -3.03%
fused_moe:1-64-8-3584-1280-torch.bfloat16-True-silu 0.347 0.357656 -2.97%
fused_moe:1-64-8-3584-640-torch.bfloat16-False-silu 0.214 0.225888 -5.05%
fused_moe:1-64-8-3584-640-torch.bfloat16-True-silu 0.227 0.238888 -5.03%
fused_moe:1-8-2-4096-3584-torch.bfloat16-False-silu 0.276 0.283218 -2.52%
fused_moe:1-8-2-4096-3584-torch.bfloat16-True-silu 0.283 0.289796 -2.36%
fused_moe:1-8-2-4096-7168-torch.bfloat16-True-silu 0.481 0.48386 -0.53%
fused_moe:1-8-2-8192-16384-torch.bfloat16-False-gelu 1.877 1.88053 -0.18%
fused_moe:1024-32-4-2880-2880-torch.bfloat16-False-silu 2.506 2.56875 -2.46%
fused_moe:1024-32-4-2880-2880-torch.bfloat16-True-silu 2.622 2.67636 -2.02%
fused_moe:1024-64-6-1280-1792-torch.bfloat16-False-silu 1.347 1.45122 -7.15%
fused_moe:1024-64-6-1280-1792-torch.bfloat16-True-silu 1.358 1.46702 -7.44%
fused_moe:1024-64-8-3584-1280-torch.bfloat16-False-silu 2.953 3.1779 -7.09%
fused_moe:1024-64-8-3584-1280-torch.bfloat16-True-silu 2.904 3.14314 -7.61%
fused_moe:1024-64-8-3584-640-torch.bfloat16-False-silu 1.828 2.058 -11.19%
fused_moe:1024-64-8-3584-640-torch.bfloat16-True-silu 1.821 2.05785 -11.52%
fused_moe:1024-8-2-4096-3584-torch.bfloat16-False-silu 1.669 1.70544 -2.13%
fused_moe:1024-8-2-4096-3584-torch.bfloat16-True-silu 1.560 1.59835 -2.37%
fused_moe:1024-8-2-4096-7168-torch.bfloat16-False-silu 2.900 2.93051 -1.04%
fused_moe:1024-8-2-4096-7168-torch.bfloat16-True-silu 2.668 2.70124 -1.23%
fused_moe:1024-8-2-8192-16384-torch.bfloat16-True-gelu 16.912 16.9499 -0.23%
fused_moe:128-32-4-2880-2880-torch.bfloat16-True-silu 2.140 2.17511 -1.60%
fused_moe:128-64-6-1280-1792-torch.bfloat16-False-silu 1.120 1.12627 -0.53%
fused_moe:128-64-8-3584-1280-torch.bfloat16-False-silu 2.291 2.30407 -0.58%
fused_moe:128-64-8-3584-1280-torch.bfloat16-True-silu 2.300 2.30474 -0.22%
fused_moe:128-64-8-3584-640-torch.bfloat16-False-silu 1.203 1.21836 -1.28%
fused_moe:128-64-8-3584-640-torch.bfloat16-True-silu 1.219 1.23094 -0.98%
fused_moe:128-8-2-4096-7168-torch.bfloat16-True-silu 2.079 2.1527 -3.43%
fused_moe:2048-32-4-2880-2880-torch.bfloat16-False-silu 3.804 3.86558 -1.59%
fused_moe:2048-32-4-2880-2880-torch.bfloat16-True-silu 3.836 3.90151 -1.68%
fused_moe:2048-64-6-1280-1792-torch.bfloat16-False-silu 1.636 1.84543 -11.34%
fused_moe:2048-64-6-1280-1792-torch.bfloat16-True-silu 1.657 1.87338 -11.55%
fused_moe:2048-64-8-3584-1280-torch.bfloat16-False-silu 4.622 4.94832 -6.59%
fused_moe:2048-64-8-3584-1280-torch.bfloat16-True-silu 4.332 4.71344 -8.09%
fused_moe:2048-64-8-3584-640-torch.bfloat16-False-silu 2.727 3.18588 -14.41%
fused_moe:2048-64-8-3584-640-torch.bfloat16-True-silu 2.728 3.17476 -14.08%
fused_moe:2048-8-2-4096-7168-torch.bfloat16-False-silu 5.547 5.59824 -0.92%
fused_moe:4096-32-4-2880-2880-torch.bfloat16-False-silu 6.585 6.68283 -1.47%
fused_moe:4096-32-4-2880-2880-torch.bfloat16-True-silu 6.648 6.76406 -1.72%
fused_moe:4096-64-6-1280-1792-torch.bfloat16-False-silu 2.872 3.21875 -10.77%
fused_moe:4096-64-6-1280-1792-torch.bfloat16-True-silu 2.884 3.22566 -10.60%
fused_moe:4096-64-8-3584-1280-torch.bfloat16-False-silu 7.442 8.13202 -8.49%
fused_moe:4096-64-8-3584-1280-torch.bfloat16-True-silu 7.724 8.39628 -8.01%
fused_moe:4096-64-8-3584-640-torch.bfloat16-False-silu 4.572 5.4653 -16.34%
fused_moe:4096-64-8-3584-640-torch.bfloat16-True-silu 4.637 5.52932 -16.13%
fused_moe:4096-8-2-4096-7168-torch.bfloat16-False-silu 9.277 9.41876 -1.51%
fused_moe:512-32-4-2880-2880-torch.bfloat16-False-silu 2.178 2.20646 -1.27%
fused_moe:512-32-4-2880-2880-torch.bfloat16-True-silu 2.192 2.21728 -1.14%
fused_moe:512-64-6-1280-1792-torch.bfloat16-False-silu 1.218 1.26911 -4.03%
fused_moe:512-64-6-1280-1792-torch.bfloat16-True-silu 1.229 1.28466 -4.31%
fused_moe:512-64-8-3584-1280-torch.bfloat16-False-silu 2.448 2.56027 -4.37%
fused_moe:512-64-8-3584-1280-torch.bfloat16-True-silu 2.459 2.57803 -4.61%
fused_moe:512-64-8-3584-640-torch.bfloat16-False-silu 1.428 1.52922 -6.62%
fused_moe:512-64-8-3584-640-torch.bfloat16-True-silu 1.451 1.55009 -6.37%
fused_moe:512-8-2-4096-3584-torch.bfloat16-False-silu 1.235 1.25096 -1.25%
fused_moe:512-8-2-4096-3584-torch.bfloat16-True-silu 1.256 1.28838 -2.50%
fused_moe:512-8-2-4096-7168-torch.bfloat16-False-silu 2.092 2.11905 -1.29%
fused_moe:512-8-2-4096-7168-torch.bfloat16-True-silu 2.051 2.07397 -1.10%
fused_moe:512-8-2-8192-16384-torch.bfloat16-False-gelu 8.477 8.51864 -0.48%
fused_moe:512-8-2-8192-16384-torch.bfloat16-True-gelu 8.556 8.56344 -0.09%
fused_moe:8192-32-4-2880-2880-torch.bfloat16-False-silu 12.015 12.2032 -1.54%
fused_moe:8192-32-4-2880-2880-torch.bfloat16-True-silu 12.092 12.2867 -1.59%
fused_moe:8192-64-6-1280-1792-torch.bfloat16-False-silu 5.308 5.76077 -7.85%
fused_moe:8192-64-6-1280-1792-torch.bfloat16-True-silu 5.326 5.78937 -8.01%
fused_moe:8192-64-8-3584-1280-torch.bfloat16-False-silu 13.816 15.2426 -9.36%
fused_moe:8192-64-8-3584-1280-torch.bfloat16-True-silu 13.720 15.1701 -9.56%
fused_moe:8192-64-8-3584-640-torch.bfloat16-False-silu 8.421 10.3308 -18.49%
fused_moe:8192-64-8-3584-640-torch.bfloat16-True-silu 8.443 10.3384 -18.34%
fused_moe:8192-8-2-4096-7168-torch.bfloat16-False-silu 18.163 18.3927 -1.25%

HIGHER (log > baseline)

num_tokens - num_experts - topk - hidden_size - shard_intermediate_size log baseline ratio
fused_moe:1-8-2-4096-7168-torch.bfloat16-False-silu 0.481 0.481052 +0.03%
fused_moe:1-8-2-8192-16384-torch.bfloat16-True-gelu 1.884 1.88235 +0.10%
fused_moe:1024-8-2-8192-16384-torch.bfloat16-False-gelu 14.219 14.2169 +0.01%
fused_moe:128-32-4-2880-2880-torch.bfloat16-False-silu 2.144 2.11827 +1.23%
fused_moe:128-64-6-1280-1792-torch.bfloat16-True-silu 1.137 1.13706 +0.02%
fused_moe:128-8-2-4096-3584-torch.bfloat16-False-silu 1.186 1.13331 +4.69%
fused_moe:128-8-2-4096-3584-torch.bfloat16-True-silu 1.144 1.0984 +4.17%
fused_moe:128-8-2-4096-7168-torch.bfloat16-False-silu 2.098 2.04344 +2.66%
fused_moe:128-8-2-8192-16384-torch.bfloat16-False-gelu 8.554 8.5422 +0.13%
fused_moe:128-8-2-8192-16384-torch.bfloat16-True-gelu 8.562 8.55254 +0.11%
fused_moe:2048-8-2-4096-3584-torch.bfloat16-False-silu 2.950 2.90584 +1.51%
fused_moe:2048-8-2-4096-3584-torch.bfloat16-True-silu 2.812 2.77888 +1.19%
fused_moe:2048-8-2-4096-7168-torch.bfloat16-True-silu 5.670 5.61465 +0.99%
fused_moe:2048-8-2-8192-16384-torch.bfloat16-False-gelu 22.853 22.7313 +0.53%
fused_moe:2048-8-2-8192-16384-torch.bfloat16-True-gelu 23.123 22.996 +0.55%
fused_moe:4096-8-2-4096-3584-torch.bfloat16-False-silu 5.173 5.08732 +1.68%
fused_moe:4096-8-2-4096-3584-torch.bfloat16-True-silu 5.455 5.33426 +2.27%
fused_moe:4096-8-2-4096-7168-torch.bfloat16-True-silu 9.789 9.71391 +0.78%
fused_moe:4096-8-2-8192-16384-torch.bfloat16-False-gelu 41.180 40.8911 +0.71%
fused_moe:4096-8-2-8192-16384-torch.bfloat16-True-gelu 43.953 43.8217 +0.30%
fused_moe:8192-8-2-4096-3584-torch.bfloat16-False-silu 9.926 9.73216 +1.99%
fused_moe:8192-8-2-4096-3584-torch.bfloat16-True-silu 9.674 9.46182 +2.25%
fused_moe:8192-8-2-4096-7168-torch.bfloat16-True-silu 18.740 18.5002 +1.29%
fused_moe:8192-8-2-8192-16384-torch.bfloat16-False-gelu 81.385 80.8513 +0.66%
fused_moe:8192-8-2-8192-16384-torch.bfloat16-True-gelu 81.779 81.2379 +0.67%

EQUAL

None

Flash Attention Benchmark Comparison

Ratio = log / baseline (lower is better)

LOWER (log < baseline)

config log baseline ratio
flash_attn:1-1-4096-16-4-128-False-False-False-0 0.053 0.139256 -61.70%
flash_attn:1-1-4096-16-4-128-False-False-False-128 0.060 0.064792 -6.75%
flash_attn:1-1-4096-16-4-256-False-False-False-0 0.103 0.37518 -72.51%
flash_attn:1-1-4096-16-4-256-False-False-False-128 0.102 0.106808 -4.42%
flash_attn:1-1-4096-16-4-512-False-False-False-0 0.194 8.73798 -97.78%
flash_attn:1-1-4096-16-4-512-False-False-False-128 0.191 0.204672 -6.51%
flash_attn:1-1-4096-16-4-64-False-False-False-128 0.041 0.045864 -10.51%
flash_attn:1-1-4096-16-8-128-False-False-False-0 0.090 0.1456 -38.33%
flash_attn:1-1-4096-16-8-128-False-False-False-128 0.065 0.09438 -31.52%
flash_attn:1-1-4096-16-8-256-False-False-False-0 0.140 0.375024 -62.79%
flash_attn:1-1-4096-16-8-256-False-False-False-128 0.110 0.145548 -24.75%
flash_attn:1-1-4096-16-8-512-False-False-False-0 0.234 8.83847 -97.36%
flash_attn:1-1-4096-16-8-512-False-False-False-128 0.189 0.241852 -21.85%
flash_attn:1-1-4096-16-8-64-False-False-False-128 0.041 0.056342 -26.60%
flash_attn:1-128-4096-16-4-128-False-True-False-0 0.146 0.183378 -20.47%
flash_attn:1-128-4096-16-4-256-False-False-False-0 0.234 0.373516 -37.28%
flash_attn:1-128-4096-16-4-256-False-True-False-0 0.144 0.408356 -64.66%
flash_attn:1-128-4096-16-4-256-False-True-False-128 0.332 0.420446 -20.99%
flash_attn:1-128-4096-16-4-256-True-False-False-0 0.236 0.396916 -40.49%
flash_attn:1-128-4096-16-4-512-False-False-False-0 1.448 8.96423 -83.84%
flash_attn:1-128-4096-16-4-512-False-False-False-128 2.050 3.11943 -34.28%
flash_attn:1-128-4096-16-4-512-False-True-False-0 0.361 8.93404 -95.96%
flash_attn:1-128-4096-16-4-512-False-True-False-128 1.229 8.90581 -86.20%
flash_attn:1-128-4096-16-4-512-True-False-False-0 1.451 9.57294 -84.84%
flash_attn:1-128-4096-16-4-512-True-False-False-128 1.997 3.0848 -35.26%
flash_attn:1-128-4096-16-4-64-False-False-True-128 0.098 0.194688 -49.49%
flash_attn:1-128-4096-16-4-64-False-True-False-128 0.109 0.276952 -60.55%
flash_attn:1-128-4096-16-4-64-False-True-True-128 0.116 0.280176 -58.51%
flash_attn:1-128-4096-16-4-64-True-False-True-128 0.100 0.21866 -54.41%
flash_attn:1-128-4096-16-8-256-False-False-False-0 0.239 0.3705 -35.43%
flash_attn:1-128-4096-16-8-256-False-True-False-0 0.026 0.405704 -93.68%
flash_attn:1-128-4096-16-8-256-False-True-False-128 0.374 0.41184 -9.12%
flash_attn:1-128-4096-16-8-256-True-False-False-0 0.239 0.3952 -39.48%
flash_attn:1-128-4096-16-8-512-False-False-False-0 1.498 8.9907 -83.33%
flash_attn:1-128-4096-16-8-512-False-False-False-128 2.062 3.25101 -36.58%
flash_attn:1-128-4096-16-8-512-False-True-False-0 0.372 8.98526 -95.86%
flash_attn:1-128-4096-16-8-512-False-True-False-128 0.694 9.08968 -92.36%
flash_attn:1-128-4096-16-8-512-True-False-False-0 1.507 9.65084 -84.38%
flash_attn:1-128-4096-16-8-512-True-False-False-128 1.997 3.21095 -37.81%
flash_attn:1-128-4096-16-8-64-False-False-True-128 0.099 0.191828 -48.55%
flash_attn:1-128-4096-16-8-64-False-True-False-128 0.067 0.278044 -75.91%
flash_attn:1-128-4096-16-8-64-False-True-True-128 0.065 0.27794 -76.61%
flash_attn:1-128-4096-16-8-64-True-False-True-128 0.100 0.216788 -53.99%
flash_attn:16-1-4096-16-4-128-False-False-False-0 0.375 1.28372 -70.76%
flash_attn:16-1-4096-16-4-128-False-False-False-128 0.218 0.365664 -40.49%
flash_attn:16-1-4096-16-4-256-False-False-False-0 0.693 4.79398 -85.55%
flash_attn:16-1-4096-16-4-256-False-False-False-128 0.420 0.673348 -37.58%
flash_attn:16-1-4096-16-4-512-False-False-False-0 1.323 136.505 -99.03%
flash_attn:16-1-4096-16-4-512-False-False-False-128 0.864 1.32306 -34.73%
flash_attn:16-1-4096-16-4-64-False-False-False-128 0.139 0.21502 -35.42%
flash_attn:16-1-4096-16-8-128-False-False-False-0 0.673 1.36214 -50.57%
flash_attn:16-1-4096-16-8-128-False-False-False-128 0.372 0.661544 -43.73%
flash_attn:16-1-4096-16-8-256-False-False-False-0 1.399 4.76817 -70.66%
flash_attn:16-1-4096-16-8-256-False-False-False-128 0.704 1.26875 -44.50%
flash_attn:16-1-4096-16-8-512-False-False-False-0 2.920 137.833 -97.88%
flash_attn:16-1-4096-16-8-512-False-False-False-128 1.352 2.57873 -47.57%
flash_attn:16-1-4096-16-8-64-False-False-False-128 0.217 0.3653 -40.56%
flash_attn:16-128-4096-16-4-128-False-True-False-0 0.933 1.52922 -39.00%
flash_attn:16-128-4096-16-4-128-False-True-False-128 1.164 1.60165 -27.35%
flash_attn:16-128-4096-16-4-256-False-False-False-0 2.977 4.78735 -37.81%
flash_attn:16-128-4096-16-4-256-False-True-False-0 1.593 5.20562 -69.41%
flash_attn:16-128-4096-16-4-256-False-True-False-128 2.369 5.3398 -55.63%
flash_attn:16-128-4096-16-4-256-True-False-False-0 3.001 5.0961 -41.11%
flash_attn:16-128-4096-16-4-512-False-False-False-0 20.010 138.432 -85.55%
flash_attn:16-128-4096-16-4-512-False-False-False-128 26.076 39.5081 -34.00%
flash_attn:16-128-4096-16-4-512-False-True-False-0 11.020 138.336 -92.03%
flash_attn:16-128-4096-16-4-512-False-True-False-128 14.728 139.183 -89.42%
flash_attn:16-128-4096-16-4-512-True-False-False-0 20.159 146.089 -86.20%
flash_attn:16-128-4096-16-4-512-True-False-False-128 25.341 39.1857 -35.33%
flash_attn:16-128-4096-16-4-64-False-False-True-128 0.537 0.874224 -38.60%
flash_attn:16-128-4096-16-4-64-False-True-False-128 0.616 1.19881 -48.62%
flash_attn:16-128-4096-16-4-64-False-True-True-128 0.583 1.19766 -51.35%
flash_attn:16-128-4096-16-4-64-True-False-True-128 0.539 0.970138 -44.43%
flash_attn:16-128-4096-16-8-128-False-True-False-0 0.722 1.64965 -56.22%
flash_attn:16-128-4096-16-8-256-False-False-False-0 2.959 4.77116 -37.97%
flash_attn:16-128-4096-16-8-256-False-True-False-0 0.292 5.17707 -94.37%
flash_attn:16-128-4096-16-8-256-False-True-False-128 4.684 5.24789 -10.74%
flash_attn:16-128-4096-16-8-256-True-False-False-0 2.993 5.04748 -40.71%
flash_attn:16-128-4096-16-8-512-False-False-False-0 25.266 139.28 -81.86%
flash_attn:16-128-4096-16-8-512-False-False-False-128 26.182 36.8448 -28.94%
flash_attn:16-128-4096-16-8-512-False-True-False-0 24.876 139.439 -82.16%
flash_attn:16-128-4096-16-8-512-False-True-False-128 2.956 139.928 -97.89%
flash_attn:16-128-4096-16-8-512-True-False-False-0 24.906 147.379 -83.10%
flash_attn:16-128-4096-16-8-512-True-False-False-128 25.313 35.6149 -28.92%
flash_attn:16-128-4096-16-8-64-False-False-True-128 0.606 0.889096 -31.83%
flash_attn:16-128-4096-16-8-64-False-True-False-128 0.157 1.18316 -86.75%
flash_attn:16-128-4096-16-8-64-False-True-True-128 0.753 1.19389 -36.97%
flash_attn:16-128-4096-16-8-64-True-False-True-128 0.603 0.976092 -38.17%
flash_attn:8-1-4096-16-4-128-False-False-False-0 0.220 0.732212 -70.00%
flash_attn:8-1-4096-16-4-128-False-False-False-128 0.140 0.216892 -35.36%
flash_attn:8-1-4096-16-4-256-False-False-False-0 0.370 2.57899 -85.67%
flash_attn:8-1-4096-16-4-256-False-False-False-128 0.226 0.36712 -38.43%
flash_attn:8-1-4096-16-4-512-False-False-False-0 0.689 69.8359 -99.01%
flash_attn:8-1-4096-16-4-512-False-False-False-128 0.462 0.683228 -32.41%
flash_attn:8-1-4096-16-4-64-False-False-False-128 0.089 0.13806 -35.38%
flash_attn:8-1-4096-16-8-128-False-False-False-0 0.371 0.78442 -52.67%
flash_attn:8-1-4096-16-8-128-False-False-False-128 0.219 0.364988 -40.08%
flash_attn:8-1-4096-16-8-256-False-False-False-0 0.697 2.56012 -72.78%
flash_attn:8-1-4096-16-8-256-False-False-False-128 0.386 0.667394 -42.11%
flash_attn:8-1-4096-16-8-512-False-False-False-0 1.437 69.6255 -97.94%
flash_attn:8-1-4096-16-8-512-False-False-False-128 0.762 1.31401 -42.04%
flash_attn:8-1-4096-16-8-64-False-False-False-128 0.139 0.216736 -35.93%
flash_attn:8-128-4096-16-4-128-False-True-False-0 0.130 0.873366 -85.09%
flash_attn:8-128-4096-16-4-128-False-True-False-128 0.310 0.913484 -66.03%
flash_attn:8-128-4096-16-4-256-False-False-False-0 1.635 2.54712 -35.82%
flash_attn:8-128-4096-16-4-256-False-True-False-0 0.919 2.79276 -67.11%
flash_attn:8-128-4096-16-4-256-False-True-False-128 2.224 2.87732 -22.72%
flash_attn:8-128-4096-16-4-256-True-False-False-0 1.648 2.71294 -39.27%
flash_attn:8-128-4096-16-4-512-False-False-False-0 10.849 70.1868 -84.54%
flash_attn:8-128-4096-16-4-512-False-False-False-128 13.082 20.4255 -35.95%
flash_attn:8-128-4096-16-4-512-False-True-False-0 8.065 70.0874 -88.49%
flash_attn:8-128-4096-16-4-512-False-True-False-128 7.516 70.4383 -89.33%
flash_attn:8-128-4096-16-4-512-True-False-False-0 10.780 74.0288 -85.44%
flash_attn:8-128-4096-16-4-512-True-False-False-128 12.719 20.4417 -37.78%
flash_attn:8-128-4096-16-4-64-False-False-True-128 0.288 0.451958 -36.25%
flash_attn:8-128-4096-16-4-64-False-True-False-128 0.207 0.604552 -65.75%
flash_attn:8-128-4096-16-4-64-False-True-True-128 0.218 0.61009 -64.34%
flash_attn:8-128-4096-16-4-64-True-False-True-128 0.289 0.510172 -43.44%
flash_attn:8-128-4096-16-8-128-False-True-False-0 0.852 0.941304 -9.50%
flash_attn:8-128-4096-16-8-128-False-True-False-128 0.504 0.966004 -47.80%
flash_attn:8-128-4096-16-8-256-False-False-False-0 1.613 2.51532 -35.86%
flash_attn:8-128-4096-16-8-256-False-True-False-0 1.501 2.76396 -45.69%
flash_attn:8-128-4096-16-8-256-False-True-False-128 1.918 2.82142 -32.02%
flash_attn:8-128-4096-16-8-256-True-False-False-0 1.649 2.68536 -38.59%
flash_attn:8-128-4096-16-8-512-False-False-False-0 13.113 71.1432 -81.57%
flash_attn:8-128-4096-16-8-512-False-False-False-128 13.148 19.0868 -31.12%
flash_attn:8-128-4096-16-8-512-False-True-False-0 12.196 71.0244 -82.83%
flash_attn:8-128-4096-16-8-512-False-True-False-128 7.511 71.1556 -89.44%
flash_attn:8-128-4096-16-8-512-True-False-False-0 13.082 75.0856 -82.58%
flash_attn:8-128-4096-16-8-512-True-False-False-128 12.708 18.5447 -31.47%
flash_attn:8-128-4096-16-8-64-False-False-True-128 0.341 0.457704 -25.49%
flash_attn:8-128-4096-16-8-64-False-True-False-128 0.267 0.6084 -56.12%
flash_attn:8-128-4096-16-8-64-False-True-True-128 0.344 0.612508 -43.78%
flash_attn:8-128-4096-16-8-64-True-False-True-128 0.331 0.509548 -35.11%

HIGHER (log > baseline)

config log baseline ratio
flash_attn:1-128-4096-16-4-128-False-False-False-0 0.221 0.140296 +57.52%
flash_attn:1-128-4096-16-4-128-False-False-False-128 0.360 0.219622 +63.70%
flash_attn:1-128-4096-16-4-128-False-True-False-128 0.213 0.199264 +6.67%
flash_attn:1-128-4096-16-4-128-True-False-False-0 0.221 0.164788 +34.07%
flash_attn:1-128-4096-16-4-128-True-False-False-128 0.359 0.24622 +45.65%
flash_attn:1-128-4096-16-4-256-False-False-False-128 0.733 0.361348 +102.73%
flash_attn:1-128-4096-16-4-256-True-False-False-128 0.693 0.36699 +88.71%
flash_attn:1-128-4096-16-4-64-False-False-False-128 0.200 0.10036 +99.18%
flash_attn:1-128-4096-16-4-64-True-False-False-128 0.201 0.131872 +52.06%
flash_attn:1-128-4096-16-8-128-False-False-False-0 0.224 0.14794 +51.63%
flash_attn:1-128-4096-16-8-128-False-False-False-128 0.359 0.223444 +60.76%
flash_attn:1-128-4096-16-8-128-False-True-False-0 0.195 0.190892 +2.21%
flash_attn:1-128-4096-16-8-128-False-True-False-128 0.257 0.206778 +24.45%
flash_attn:1-128-4096-16-8-128-True-False-False-0 0.224 0.16666 +34.51%
flash_attn:1-128-4096-16-8-128-True-False-False-128 0.359 0.247468 +44.95%
flash_attn:1-128-4096-16-8-256-False-False-False-128 0.731 0.35776 +104.24%
flash_attn:1-128-4096-16-8-256-True-False-False-128 0.690 0.3627 +90.25%
flash_attn:1-128-4096-16-8-64-False-False-False-128 0.200 0.100412 +98.82%
flash_attn:1-128-4096-16-8-64-True-False-False-128 0.200 0.132236 +51.44%
flash_attn:16-128-4096-16-4-128-False-False-False-0 1.918 1.27982 +49.88%
flash_attn:16-128-4096-16-4-128-False-False-False-128 2.885 1.94303 +48.50%
flash_attn:16-128-4096-16-4-128-True-False-False-0 1.903 1.41034 +34.91%
flash_attn:16-128-4096-16-4-128-True-False-False-128 2.856 2.04274 +39.79%
flash_attn:16-128-4096-16-4-256-False-False-False-128 8.975 4.59264 +95.41%
flash_attn:16-128-4096-16-4-256-True-False-False-128 8.695 4.65218 +86.90%
flash_attn:16-128-4096-16-4-64-False-False-False-128 1.024 0.52286 +95.86%
flash_attn:16-128-4096-16-4-64-True-False-False-128 1.146 0.623584 +83.72%
flash_attn:16-128-4096-16-8-128-False-False-False-0 2.065 1.35132 +52.83%
flash_attn:16-128-4096-16-8-128-False-False-False-128 2.910 2.10626 +38.18%
flash_attn:16-128-4096-16-8-128-False-True-False-128 2.042 1.67409 +21.99%
flash_attn:16-128-4096-16-8-128-True-False-False-0 2.023 1.48231 +36.47%
flash_attn:16-128-4096-16-8-128-True-False-False-128 2.851 2.15673 +32.19%
flash_attn:16-128-4096-16-8-256-False-False-False-128 8.970 4.56009 +96.71%
flash_attn:16-128-4096-16-8-256-True-False-False-128 8.588 4.60444 +86.51%
flash_attn:16-128-4096-16-8-64-False-False-False-128 1.041 0.567112 +83.61%
flash_attn:16-128-4096-16-8-64-True-False-False-128 1.156 0.659048 +75.46%
flash_attn:8-128-4096-16-4-128-False-False-False-0 1.075 0.724204 +48.47%
flash_attn:8-128-4096-16-4-128-False-False-False-128 1.646 1.09975 +49.70%
flash_attn:8-128-4096-16-4-128-True-False-False-0 1.063 0.800904 +32.70%
flash_attn:8-128-4096-16-4-128-True-False-False-128 1.608 1.14431 +40.55%
flash_attn:8-128-4096-16-4-256-False-False-False-128 4.817 2.45762 +95.99%
flash_attn:8-128-4096-16-4-256-True-False-False-128 4.633 2.49759 +85.48%
flash_attn:8-128-4096-16-4-64-False-False-False-128 0.542 0.286 +89.48%
flash_attn:8-128-4096-16-4-64-True-False-False-128 0.585 0.34034 +71.92%
flash_attn:8-128-4096-16-8-128-False-False-False-0 1.175 0.771576 +52.29%
flash_attn:8-128-4096-16-8-128-False-False-False-128 1.661 1.1985 +38.57%
flash_attn:8-128-4096-16-8-128-True-False-False-0 1.158 0.845234 +37.01%
flash_attn:8-128-4096-16-8-128-True-False-False-128 1.611 1.22829 +31.13%
flash_attn:8-128-4096-16-8-256-False-False-False-128 4.813 2.41098 +99.61%
flash_attn:8-128-4096-16-8-256-True-False-False-128 4.563 2.44899 +86.31%
flash_attn:8-128-4096-16-8-64-False-False-False-128 0.549 0.32071 +71.09%
flash_attn:8-128-4096-16-8-64-True-False-False-128 0.598 0.364676 +63.94%

EQUAL

None

Copilot AI lite review requested due to automatic review settings August 6, 2026 10:18
Copilot AI reviewed Aug 6, 2026
View reviewed changes

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the repository’s benchmark performance baselines used by CI comparisons, incorporating the latest measured improvements for Fused MoE and Flash Attention so future benchmark runs are evaluated against the new best-known results.

Changes:

  • Update multiple fused_moe:* baseline entries to lower (faster) timings.
  • Update multiple flash_attn:* baseline entries to lower (faster) timings.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Copilot code review Copilot
Copilot review effort
Applies to this pull request for everyone.Learn more about Copilot code review.
Copilot left review comments

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@MingxuZh