You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit a9dcd8e
Browse filesBrowse the repository at this point in the historyBrowse files
* diloco: stop the first-heartbeat catch-up from inflating the token rate
A worker's first heartbeat reports its whole cumulative token count (the
aggregator credits the full cumulative on a first report). With N workers those
first reports land within ~1-2s, so total_tokens leaps from 0 to N-workers'
worth of pre-heartbeat history in a tiny wall-clock window — and the rolling
rate divided that jump by that interval, grossly overstating throughput (and
underestimating the ETA) for the first few minutes until the window slid past
the burst.
Add StatsAggregator.steady_tokens: like total_tokens but excluding each
worker's first-report catch-up (only true per-heartbeat increments), mirroring
the existing flos_window treatment. The rolling-rate sampler reads steady_tokens
instead of total_tokens, so the catch-up never enters the rate; total_tokens
(with catch-up) still drives the budget percent/ETA-remaining, which is correct
(those tokens are real). During warm-up — only catch-ups so far, steady_tokens
still 0 — the rate reads 'unknown' (None) rather than a misleading 0 or an
inflated burst.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* webui: default the DiLoCo 'Generate' worker count to 1
For the common small-worker-count case it's quicker to leave it at 1 and click
Generate N times than to edit the number first (which is usually not the value
you want anyway).
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
0 commit comments