transformers
f4c9a7e6
- Accumulate opt state dict on do_rank 0 (#11481)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 years ago
Accumulate opt state dict on do_rank 0 (#11481)
References
#11481 - Fix checkpointing in SageMaker MP
Author
sgugger
Parents
1e8e0686
Loading
