transformers
4d0ea3d2 - Cuda rng_state_all is used when saving in distributed mode so same should also be used when loading (#23045)

Commit

2 years ago

Cuda rng_state_all is used when saving in distributed mode so same should also be used when loading (#23045) cuda rng state should be all for distributed bc all were saved

References

Author

ShivamShrirao

Parents

transformers 4d0ea3d2 - Cuda rng_state_all is used when saving in distributed mode so same should also be used when loading (#23045)

transformers
4d0ea3d2 - Cuda rng_state_all is used when saving in distributed mode so same should also be used when loading (#23045)