DeepSpeed
get_grad_norm_direct: fix a case of empty norm group
#5148
Merged

Commits
  • get_grad_norm_direct: fix a case of empty norm group
    Nadav Elyahu committed 2 years ago
  • Merge branch 'master' into fix_get_grad_norm_direct
    lekurile committed 2 years ago
  • Fix the way torch.float32 gets initialized
    lekurile committed 2 years ago
Loading