DeepSpeed
get_grad_norm_direct: fix a case of empty norm group
#5148

Merged

get_grad_norm_direct: fix a case of empty norm group #5148

lekurile merged 3 commits into deepspeedai:master from nelyahu:fix_get_grad_norm_direct

get_grad_norm_direct: fix a case of empty norm group

eb726b84

nelyahu requested a review from

tjruwase 1 year ago

nelyahu requested a review from

mrwyattii 1 year ago

Merge branch 'master' into fix_get_grad_norm_direct

e3a04dc8

lekurile requested a review from

lekurile 1 year ago

Fix the way torch.float32 gets initialized

e85eee6a

lekurile approved these changes on 2024-02-20

lekurile merged f062a1b2 into master 1 year ago

nelyahu deleted the fix_get_grad_norm_direct branch 1 year ago

Reviewers

lekurile

tjruwase

mrwyattii

Assignees

No one assigned

Labels

None yet

Milestone

No milestone