Skip to content

Commit 070a043

Browse files
committed
grammar fix
Signed-off-by: Hao Wu <skyw@nvidia.com>
1 parent ac6a500 commit 070a043

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

‎emerging_optimizers/shampoo/shampoo.py‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -195,8 +195,8 @@ def init_state(
195195
{
196196
"Q_L": torch.eye(m, device=device),
197197
"Q_R": torch.eye(n, device=device),
198-
# Initialize eigen values one to skip KL correction for the first step.
199-
# They'll be override right after
198+
# Initialize eigenvalues to one to skip KL correction for the first step.
199+
# They will be overwritten immediately afterward.
200200
"eigvals_L": torch.ones(m, device=device),
201201
"eigvals_R": torch.ones(n, device=device),
202202
}

0 commit comments

Comments
 (0)