Skip to content
This repository was archived by the owner on Mar 21, 2026. It is now read-only.

fix(num_devices): fix num_shard/num device auto compute when NVIDIA_VISIBLE_DEVICES == "all" or "void" - #3346

Merged
oOraph merged 2 commits into
mainfrom
fix_num_shard_auto_compute
Dec 18, 2025
Merged

fix(num_devices): fix num_shard/num device auto compute when NVIDIA_VISIBLE_DEVICES == "all" or "void"#3346
oOraph merged 2 commits into
mainfrom
fix_num_shard_auto_compute

fix(num_shard): make TGI compliant with nvidia-container-toolkit in c…

60a2a4b
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar