Skip to content

[bug] LoRA adapter init depends on tensor parallel size: linear_in is initialized per shard with a fan-dependent method #21896

[bug] LoRA adapter init depends on tensor parallel size: linear_in is initialized per shard with a fan-dependent method

[bug] LoRA adapter init depends on tensor parallel size: linear_in is initialized per shard with a fan-dependent method #21896