transformers
1b6cb1ee
- don't use no_sync when deepspeed doesn't support it for certain zero stages (#35157)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
don't use no_sync when deepspeed doesn't support it for certain zero stages (#35157) * don't use no_sync when deepspeed doesn't support it for certain zero stages * chore: lint * fix no_sync context for deepspeed across all zero types * chore: lint
Author
winglian
Committer
ArthurZucker
Parents
b1d5d6dd
Loading