@@ -175,7 +175,7 @@ items:
175175 moe_dispatcher : hybridep
176176 command : >
177177 ./scripts/training/train.sh --nodes 2 --gpus-per-node 8
178- --recipe qwen35_vl_35b_a3b_pretrain_16gpu_h100_bf16_functional_config
178+ --recipe qwen35_vl_35b_a3b_pretrain_config
179179 --dataset energon
180180 --pretrained_checkpoint
181181 work/model-verification/qwen3.6-35b-a3b/imported-megatron/iter_0000000
@@ -199,33 +199,15 @@ items:
199199 last_10_steps_model_tflops_per_gpu_avg : 135.610
200200 last_10_steps_tokens_per_second_per_gpu_avg : 5885.264
201201 expected_result : >
202- The historical compatibility recipe name and logical output path
203- preserve the identity of the 16-H100 workload that completed all 50
204- DataComp Energon steps at
205- TP1/PP2/CP1/EP8/ETP1, a 16/24 language-layer pipeline split, and
206- MBS1/GBS512. The reusable recipe left the pretrained checkpoint unset;
207- the command warm-started all trainable weights from the immutable
208- imported Qwen3.6 checkpoint for representative natural router traffic.
209- The persisted config confirmed the 248,320-token model vocabulary,
210- HybridEP, selective core-attention, GDN output-norm, and MoE-activation
211- recompute, scoped Transformer Engine CUDA graphs for language
212- attention/router/preprocessing, a graph-free variable-shape vision
213- encoder, and Transformer Engine fused cross entropy. Loss remained
214- finite from 3.604611 to 3.458849 with zero skipped or NaN iterations.
215- Steps 41-50 averaged 22,271.220 ms and 135.610 model TFLOP/s/GPU,
216- approximately 136, and the process exited successfully without
217- checkpoint output. The public command omits the historical invocation's
218- redundant `checkpoint.save=null`; the persisted recipe configuration
219- already left checkpoint saving unset. This verifies bounded full-model
220- DataComp training, not canonical DataComp/CLIP convergence or checkpoint
221- resume. The data
222- was prepared from the official DataComp downloader at commit
223- 4a8df1992566, DataComp-1B metadata revision 086ebeee20d4, and
224- img2dataset 1.40.0. The converter selected the first 525,000 valid,
225- UID-deduplicated samples from sorted shards and produced a deterministic
226- 519,827/5,173 train/validation split with preparation manifest
227- 6e273a96a756; this 50-step run consumed 25,600 training samples without
228- wrapping.
202+ The 16-H100 command completed all 50 full-model DataComp Energon steps
203+ at TP1/PP2/CP1/EP8/ETP1 and MBS1/GBS512 after warm-starting the
204+ immutable imported checkpoint for natural routing. Loss remained finite
205+ from 3.604611 to 3.458849 with zero skipped or NaN iterations. The
206+ 519,827/5,173 train/validation split was prepared with the official
207+ DataComp downloader at commit 4a8df1992566, DataComp-1B metadata
208+ revision 086ebeee20d4, img2dataset 1.40.0, and preparation manifest
209+ 6e273a96a756. This verifies bounded full-model training, not canonical
210+ DataComp/CLIP convergence or checkpoint resume.
229211
230212 sft :
231213 H100 :
0 commit comments