Skip to content

fix(serve): size tensor parallelism from the target instance's GPUs - #6433

Open
AkshayShah03 wants to merge 1 commit into
aws:masterfrom
AkshayShah03:fix/tensor-parallel-degree-target-gpus
Open

fix(serve): size tensor parallelism from the target instance's GPUs#6433
AkshayShah03 wants to merge 1 commit into
aws:masterfrom
AkshayShah03:fix/tensor-parallel-degree-target-gpus

fix(serve): size tensor parallelism from the target instance's GPUs

c92ffc8
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar