Repository navigation

fix(training): train the DSpark TV term at 0.5 * L1 as documented - #5241

Closed

khazic wants to merge 6 commits into

NVIDIA-NeMo:mainfrom

khazic:khazic/fix/dspark-tv-half-factor

Closed

fix(training): train the DSpark TV term at 0.5 * L1 as documented#5241
khazic wants to merge 6 commits into
NVIDIA-NeMo:mainfrom
khazic:khazic/fix/dspark-tv-half-factor

Commits on Aug 7, 2026
- docs(training): add DSpark speculative decoding design
  
  khazic
  authored and
  yaoyu-33
  committed
  5084ba5
- docs(training): drop the AutoModel reference-implementation section
  
  khazic
  authored and
  yaoyu-33
  committed
  93192ca
- docs(training): drop the phased plan and open-questions sections
  
  khazic
  authored and
  yaoyu-33
  committed
  a4047be
- feat(training): add DSpark draft heads and loss (algorithm core)
  
  khazic
  authored and
  yaoyu-33
  committed
  477252a
- fix(training): scope DSpark loss DP reduction to the given dp_group
  
  khazic
  authored and
  yaoyu-33
  committed
  63ad70f
- fix(training): train the DSpark TV term at 0.5 * L1 as documented
  
  khazic
  authored and
  yaoyu-33
  committed
  3cf0cea