Skip to content

Commit d45be7b

Browse files
Disable lr override (#6472)
Signed-off-by: Gautham Kollu <gkollu@nvidia.com>
1 parent 25d189d commit d45be7b

1 file changed

Lines changed: 0 additions & 3 deletions

File tree

‎src/megatron/bridge/perf_recipes/deepseek/gb300/deepseek_v3.py‎

Lines changed: 0 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -398,9 +398,6 @@ def deepseek_v3_pretrain_256gpu_gb300_fp8mx_hsdp_config() -> ConfigContainer:
398398
cfg.ddp.expert_outer_dp_sharding_strategy = "no_shard"
399399
cfg.ddp.num_distributed_optimizer_instances = 4
400400

401-
cfg.optimizer.lr = 3e-7
402-
cfg.optimizer.min_lr = 1e-7
403-
404401
cfg.model.fp8_param_gather = True
405402
cfg.model.fp8_param = True
406403
cfg.model.moe_router_dtype = "bf16"

0 commit comments

Comments
 (0)