DeepSpeed
b75647c4
- Set tp world size to 1 in ckpt load, if MPU is not provided
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Set tp world size to 1 in ckpt load, if MPU is not provided
References
#5243 - Set tp world size to 1 in ckpt load, if MPU is not provided
#5245 - Set tp to 1 when MPU is None for bf16 optimizer
Author
samadejacobs
Parents
d1536e44
Loading