Megatron-DeepSpeed
Add bias a weight we need to sync as well across TP
#307
Merged

Add bias a weight we need to sync as well across TP #307

thomasw21 merged 1 commit into main from thonmas/sync_bias_as_well
thomasw21
thomasw21 Add bias a weight we need to sync as well
2c33560c
thomasw21 thomasw21 marked this pull request as ready for review 3 years ago
thomasw21 thomasw21 requested a review from stas00 stas00 3 years ago
stas00
stas00 approved these changes on 2022-07-07
thomasw21 thomasw21 merged 0d0d84c8 into main 3 years ago
thomasw21 thomasw21 deleted the thonmas/sync_bias_as_well branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone