Skip to content

Commit ee6baa2

Browse files
authored
test(checkpointing): seed CPU initialization in checkpoint load test (#8263)
Signed-off-by: Chen Cui <chcui@nvidia.com>
1 parent 0adca65 commit ee6baa2

1 file changed

Lines changed: 2 additions & 0 deletions

File tree

‎tests/unit_tests/test_checkpointing.py‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1017,6 +1017,8 @@ def test_checkpoint_load_without_microbatch_calculator(
10171017
)
10181018

10191019
def build_model():
1020+
# CPU-initialized DP replicas must match the weights saved by rank 0.
1021+
torch.manual_seed(123)
10201022
return (
10211023
GPTModel(
10221024
config=config,

0 commit comments

Comments
 (0)