DeepSpeed
only global rank 0 can log tensorboard data; avoid multi gpu/node race for the log directory
#296
Merged

only global rank 0 can log tensorboard data; avoid multi gpu/node race for the log directory #296

arashashari merged 1 commit into master from TensorBoardDirctoryBugFix
arashashari
arashashari only global rank 0 can log tensorboard data; avoid multi gpu/node rac…
f5ac8d70
arashashari arashashari requested a review from tjruwase tjruwase 5 years ago
arashashari arashashari requested a review from jeffra jeffra 5 years ago
arashashari arashashari requested a review from samyam samyam 5 years ago
arashashari arashashari requested a review from ShadenSmith ShadenSmith 5 years ago
tjruwase
tjruwase approved these changes on 2020-07-21
ShadenSmith
ShadenSmith approved these changes on 2020-07-21
arashashari arashashari merged 1f972427 into master 5 years ago
jeffra jeffra deleted the TensorBoardDirctoryBugFix branch 5 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone