Skip to content

Commit 89ec9bc

Browse files
committed
docs(training): drop the AutoModel reference-implementation section
Requested in review: the Megatron-Bridge design doc does not need a breakdown of the AutoModel implementation; the pointer in the overview is enough. Signed-off-by: khazic <khazzz1c@gmail.com>
1 parent 85da986 commit 89ec9bc

1 file changed

Lines changed: 0 additions & 15 deletions

File tree

‎docs/training/dspark-speculative-decoding.md‎

Lines changed: 0 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -77,21 +77,6 @@ verified anchor token). `tau` is the training-time speedup proxy. The confidence
7777
head regresses to `accept_rate`; the paper applies a post-hoc Sequential
7878
Temperature Scaling calibration for serving.
7979

80-
### Reference implementation (NeMo AutoModel)
81-
82-
The AutoModel implementation separates cleanly into an architecture-agnostic core
83-
and per-target glue:
84-
85-
- Architecture-agnostic core: the Markov/RNN heads, the three-term loss and
86-
acceptance metrics, anchor sampling and block "noise" embedding, the eval mask,
87-
the confidence-head module, and the block-attention mask builder.
88-
- Per-target glue: the draft backbone (attention that reads target hidden states
89-
as context K/V, plus the decoder MLP), a draft config builder, a one-line
90-
registry entry, and the frozen-target hidden-state capture.
91-
92-
This split is what makes a Megatron-Bridge port tractable: the core is nearly
93-
verbatim, and only the backbone must be re-expressed in Megatron-Core layer specs.
94-
9580
## Where DSpark fits in Megatron-Bridge
9681

9782
### Current state

0 commit comments

Comments
 (0)