Skip to content

Commit 241dc40

Browse files
committed
fix linting
Signed-off-by: HaochenYuan <haocheny@nvidia.com>
1 parent 5c46612 commit 241dc40

2 files changed

Lines changed: 2 additions & 1 deletion

File tree

‎megatron/core/transformer/moe/fused_a2a.py‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -337,6 +337,7 @@ def _validate_hybrid_ep_ib_tx_depth(num_tokens: int, group: torch.distributed.Pr
337337
f"are at most {max_supported_tokens} for multi-node HybridEP."
338338
)
339339

340+
340341
# HybridEP dispatch/combine kernels use 64-token chunks for their public APIs.
341342
HYBRIDEP_TOKEN_ALIGNMENT = 64
342343

‎megatron/core/transformer/transformer_config.py‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -804,7 +804,7 @@ class TransformerConfig(ModelParallelConfig):
804804
This is needed when the frontend supplies locally packed THD inputs whose token counts
805805
can differ across ranks, without using Megatron Core's sequence_packing_scheduler.
806806
"""
807-
807+
808808
moe_per_layer_logging: bool = False
809809
"""Enable per-layer logging for MoE, currently supports auxiliary loss and z loss."""
810810

0 commit comments

Comments
 (0)