DeepSpeed
skip bcast when enable pp but pp_group_size=1
#3915
Merged

skip bcast when enable pp but pp_group_size=1 #3915

tjruwase merged 2 commits into deepspeedai:master from inkcherry:skip_bcast
inkcherry
inkcherry do bcast only pp_group_size>1
d06102d4
inkcherry inkcherry requested a review from ShadenSmith ShadenSmith 3 years ago
inkcherry inkcherry requested a review from duli2012 duli2012 3 years ago
loadams Merge branch 'master' into skip_bcast
fc20f461
tjruwase
tjruwase approved these changes on 2023-07-14
tjruwase tjruwase merged 05a6cee1 into master 3 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone