Repository navigation
Commit e2624a3
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
32 | 32 | | |
33 | 33 | | |
34 | 34 | | |
35 | | - | |
| 35 | + | |
36 | 36 | | |
37 | 37 | | |
38 | 38 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
Submodule Megatron-LM updated 57 files
- .github/CODEOWNERS+1-1
- .github/actions/action.yml+18-60
- .github/workflows/_release_library.yml+4-9
- .github/workflows/build-docs.yml+1-1
- .github/workflows/cicd-approve-test-queue.yml+23-6
- .github/workflows/cicd-main.yml+197-128
- docker/common/install_source_wheels.sh+1-5
- megatron/core/dist_checkpointing/serialization.py+54-96
- megatron/core/dist_checkpointing/strategies/__init__.py-6
- megatron/core/dist_checkpointing/strategies/base.py+3-40
- megatron/core/dist_checkpointing/strategies/common.py+31-168
- megatron/core/dist_checkpointing/strategies/torch.py+8-4
- megatron/core/dist_checkpointing/validation.py+11-96
- megatron/core/distributed/distributed_data_parallel_config.py+29
- megatron/core/distributed/fsdp/mcore_fsdp_adapter.py+11-6
- megatron/core/distributed/fsdp/src/megatron_fsdp/distributed_data_parallel_config.py+29
- megatron/core/distributed/fsdp/src/megatron_fsdp/megatron_fsdp.py+19-3
- megatron/core/extensions/transformer_engine.py+22
- megatron/core/inference/engines/dynamic_engine.py-27
- megatron/core/inference/text_generation_server/dynamic_text_gen_server/endpoints/chat_completions.py+33-35
- megatron/core/inference/text_generation_server/dynamic_text_gen_server/endpoints/completions.py+11-23
- megatron/core/inference/text_generation_server/dynamic_text_gen_server/text_generation_server.py+1-1
- megatron/core/inference/utils.py+38-20
- megatron/core/models/gpt/gpt_model.py+4-1
- megatron/core/rerun_state_machine.py+7-5
- megatron/core/resharding/copy_services/gloo_copy_service.py+28-8
- megatron/core/resharding/execution.py+58-11
- megatron/core/resharding/planner.py+172-20
- megatron/core/resharding/utils.py+71-23
- megatron/core/ssm/mamba_mixer.py+24-3
- megatron/core/transformer/attention.py+5-3
- megatron/core/transformer/cuda_graphs.py+112-101
- megatron/core/transformer/moe/moe_layer.py+8-7
- megatron/core/transformer/multi_token_prediction.py+6-3
- megatron/core/transformer/transformer_config.py+3
- megatron/rl/rl_utils.py+62-51
- megatron/rl/sequence_packing_utils.py+12-12
- megatron/training/checkpointing.py+3-6
- megatron/training/config/training_config.py+1-1
- megatron/training/theoretical_memory_usage.py+28
- megatron/training/training.py+71-22
- megatron/training/utils.py+15-5
- pyproject.toml-3
- tests/test_utils/recipes/h100/unit-tests.yaml+35
- tests/unit_tests/dist_checkpointing/conftest.py+2
- tests/unit_tests/dist_checkpointing/models/common.py+6-6
- tests/unit_tests/dist_checkpointing/models/test_mamba.py+6-6
- tests/unit_tests/dist_checkpointing/models/test_moe_experts.py+8-8
- tests/unit_tests/dist_checkpointing/test_fp8.py+6-6
- tests/unit_tests/dist_checkpointing/test_fully_parallel.py+1-5
- tests/unit_tests/dist_checkpointing/test_serialization.py+9-15
- tests/unit_tests/dist_checkpointing/test_torch_dist.py+2-2
- tests/unit_tests/distributed/megatron_fsdp/test_mcore_fully_sharded_data_parallel.py+3-3
- tests/unit_tests/pipeline_parallel/test_fine_grained_activation_offloading.py+2
- tests/unit_tests/resharding/test_model_swap.py+338-55
- tests/unit_tests/transformer/test_vision_cuda_graphs.py+7-2
- uv.lock-16
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
7 | | - | |
8 | | - | |
9 | | - | |
10 | | - | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
11 | 16 | | |
12 | 17 | | |
13 | 18 | | |
| |||
0 commit comments