Megatron-DeepSpeed
print number of params only on rank 0
#140
Merged

print number of params only on rank 0 #140

stas00 merged 4 commits into main from stas00-patch-1
stas00
stas00 print number of params only on rank 0
df413e35
stas00 Merge remote-tracking branch 'origin/main' into stas00-patch-1
ef292a87
stas00 update requirements
2efa2fc2
stas00 failing test with 4gpus, try 2 gpus
391930be
stas00
stas00 stas00 merged 3b22aa21 into main 4 years ago
stas00 stas00 deleted the stas00-patch-1 branch 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone