Skip to content

Commit fe50166

Browse files
Merge commit 'cd5b36f197b9a1a6ca6662b1e1704ce630addaeb' into chore/bump-mcore-dev-260812
Signed-off-by: svcnemo-autobot <svcnemo-autobot@nvidia.com>
2 parents 78e24cb + cd5b36f commit fe50166

1 file changed

Lines changed: 4 additions & 1 deletion

File tree

‎src/megatron/bridge/training/gpt_step.py‎

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -131,7 +131,10 @@ def _patch_mcore_schedule_plan_padding_mask() -> None:
131131
TODO: Remove this compatibility patch after MCore dev's schedule-plan
132132
padding-mask forwarding reaches the pinned main commit.
133133
"""
134-
from megatron.core.models.common import fine_grained_callables
134+
try:
135+
from megatron.core.models.common import fine_grained_callables
136+
except ImportError:
137+
from megatron.core.models.gpt import fine_grained_callables
135138

136139
current_builder = fine_grained_callables.build_transformer_layer_callables
137140
if getattr(current_builder, _MCORE_SCHEDULE_PADDING_MASK_PATCHED, False):

0 commit comments

Comments
 (0)