You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 66f08ac
Browse filesBrowse the repository at this point in the historyBrowse files
The surrogate is **not another LLM** - it is a classical ML or shallow DL model (the model zoo includes logistic regression, SGD, LightGBM, random forests, and small feed-forward nets). This is what makes the cost reduction real: inference is CPU-bound, sub-millisecond, and free.
74
+
The surrogate is **not another LLM** - it is a classical ML or shallow DL model (the model zoo includes logistic regression, SGD, gradient-boosted trees, random forests, and small feed-forward nets). This is what makes the cost reduction real: inference is CPU-bound, sub-millisecond, and free.
75
75
76
76
1.**Fit** - train a suite of candidate surrogates on your LLM's classification traces; select the best via cross-validated teacher agreement
77
77
2.**Gate** - attach a learned acceptor that estimates, per-input, whether the surrogate will agree with the teacher
0 commit comments