Skip to content

Support non-fp32 params in PSGDPro - #315

Open
v0ropaev wants to merge 2 commits into
NVIDIA-NeMo:mainfrom
v0ropaev:fix/psgd-param-dtype
Open

Support non-fp32 params in PSGDPro#315
v0ropaev wants to merge 2 commits into
NVIDIA-NeMo:mainfrom
v0ropaev:fix/psgd-param-dtype

Keep PSGD Kronecker factors in fp32 for low precision params

8eb6e09
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 21, 2026 in 0s

DCO

All commits are signed off!

View more details on DCO