Megatron-DeepSpeed
[microsoft/Megatron-DeepSpeed sync] Commits including 2021-08-09
#58
Merged

[microsoft/Megatron-DeepSpeed sync] Commits including 2021-08-09 #58

stas00 merged 2 commits into bigscience-workshop:main from stas00:sync3
stas00
tjruwase Use new zero.Init() API (#10)
8947494e
query deepspeed global grad norm (#8)
4e27f6d2
stas00 stas00 merged 3c9d748b into main 4 years ago
stas00 stas00 deleted the sync3 branch 4 years ago
stas00

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone