DeepSpeed
9e277ba8
- fix _all_gather in zero3
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
3 years ago
fix _all_gather in zero3
References
HeyangQin/mixed_precision_lora_sam
#3954 - MP ZeRO++
Author
HeyangQin
Parents
3d527b24
Loading
