Megatron-DeepSpeed
[microsoft/Megatron-DeepSpeed sync] Commits including 2021-08-09
#58
Merged

Commits
  • Use new zero.Init() API (#10)
    stas00 committed 4 years ago
  • query deepspeed global grad norm (#8)
    stas00 committed 4 years ago
Loading