Skip to content

feat: gate parallelism - #2295

Merged
McPatate merged 1 commit into
feat/train_encode_splitfrom
feat/gate_parallelism
Aug 5, 2026
Merged

McPatate merged 1 commit into
feat/train_encode_splitfrom
feat/gate_parallelism

Conversation

@McPatate

@McPatate McPatate commented Aug 5, 2026

Copy link
Copy Markdown
Member

No description provided.

Signed-off-by: Luc Georges <luc.sydney.georges@gmail.com>
@McPatate
McPatate merged commit 66aa671 into feat/train_encode_split Aug 5, 2026
37 of 41 checks passed
@McPatate
McPatate deleted the feat/gate_parallelism branch August 5, 2026 14:52
@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

ArthurZucker pushed a commit that referenced this pull request Sep 2, 2026
Squashed from 5 commits:
  - perf(scratch): reuse Scratch buffers across encode() calls (#2261)
  - feat: re-introduce pretokens scratch buffers (`thread_local`) (#2284)
  - perf(bpe): WordCache (#2262)
  - revert: rebase mishap, reintroduce scratch pool
  - feat: gate parallelism (#2295)

Area: core-memory-allocation, core-parallelism
Co-authored-by: Luc Georges <McPatate@users.noreply.github.com>
ArthurZucker pushed a commit that referenced this pull request Sep 2, 2026
Also reinstates the scratch pool after a rebase mishap.

Squashed from 2 commits:
  - revert: rebase mishap, reintroduce scratch pool
  - feat: gate parallelism (#2295)

Area: core-parallelism
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants