Megatron-DeepSpeed
fix(training): correct rank-zero log messages, Print total model size once at startup (rank-0) – Fixes #123
#408
Open
Open
fix(training): correct rank-zero log messages, Print total model size once at startup (rank-0) – Fixes #123 #408
MagellaX
wants to merge
1 commit into
bigscience-workshop:main
from
MagellaX:fix-training-logging
fix(training): correct rank-zero log messages
61ed02df
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub