Skip to content

Commit 846bb9f

Browse files
committed
[TRTLLM-14961][doc] Correct the documented TRTLLM_MOE_FUSED_FC2_ALPHA default
The dense-GEMM leaf enables the fused FC2 alpha only when the variable is "1"; the default is disabled, and the fused path has a known accuracy issue under TP. Signed-off-by: xxi <xxi@nvidia.com>
1 parent 9d93169 commit 846bb9f

1 file changed

Lines changed: 3 additions & 2 deletions

File tree

‎tensorrt_llm/_torch/moe/fused_moe/cutedsl/dense_gemm.py‎

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -377,8 +377,9 @@ def run_moe_nvfp4(
377377
enable_alltoall: Whether alltoall communication is enabled
378378
379379
Note:
380-
The implementation is controlled by TRTLLM_MOE_FUSED_FC2_ALPHA env var (default: enabled).
381-
When enabled, fc2_alpha is fused into FC1's alpha_post with scalar fc2_alpha_max in FC2.
380+
The implementation is controlled by TRTLLM_MOE_FUSED_FC2_ALPHA env var (default: disabled).
381+
When enabled, fc2_alpha is fused into FC1's alpha_post with scalar fc2_alpha_max in FC2;
382+
this path has a known accuracy issue under TP.
382383
When disabled, uses the original per-token per-expert fc2_alpha in FC2.
383384
"""
384385
assert self.has_nvfp4

0 commit comments

Comments
 (0)