Repository navigation
Commit bb46fee
authored
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
Submodule Megatron-LM updated 10 files
- megatron/core/distributed/fsdp/mcore_fsdp_adapter.py+19-13
- megatron/core/distributed/fsdp/src/megatron_fsdp/experimental/fully_shard.py+6
- megatron/core/distributed/fsdp/src/megatron_fsdp/experimental/module.py+39-3
- megatron/core/optimizer/cpu_offloading/hybrid_optimizer.py+3-1
- megatron/training/models/dist_utils.py+1-1
- megatron/training/training.py+1-1
- tests/unit_tests/distributed/mfsdp_v2/mcore_training_utils.py+37
- tests/unit_tests/distributed/mfsdp_v2/test_fully_shard.py+4-6
- tests/unit_tests/distributed/mfsdp_v2/test_mcore_adapter.py+291-82
- tests/unit_tests/test_optimizer_cpu_offloading.py+50
0 commit comments