accelerate
8c83b448
- Preserve zero gradient clipping in DeepSpeed configuration (#4406)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
6 days ago
Preserve zero gradient clipping in DeepSpeed configuration (#4406) An explicit zero disables clipping. Dropping this falsey value lets DeepSpeed restore its default threshold and changes the requested training update.
References
#4406 - Preserve zero gradient clipping in DeepSpeed configuration
Author
Titus-von-Koeller
Parents
abe3749c
Loading