Megatron-DeepSpeed
Thomas/olruwase/sync layer norms
#277
Merged

Thomas/olruwase/sync layer norms #277

thomasw21
thomasw21 Sync torch_rng_state
0e008dcb
thomasw21 thomasw21 changed the base branch from main to olruwase/sync_layer_norms 4 years ago
thomasw21 thomasw21 requested a review from stas00 stas00 4 years ago
stas00
stas00 commented on 2022-04-04
thomasw21 thomasw21 merged d576775c into olruwase/sync_layer_norms 4 years ago
thomasw21 thomasw21 deleted the thomas/olruwase/sync_layer_norms branch 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone