DeepSpeed
05a6cee1
- do bcast only pp_group_size>1 (#3915)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
do bcast only pp_group_size>1 (#3915) Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com>
References
#3915 - skip bcast when enable pp but pp_group_size=1
Author
inkcherry
Parents
7528035c
Loading