Sync torch_rng_state (#277) - SemanticDiff

Commit

3 years ago

Sync torch_rng_state (#277)

References

#274 - Sync 4 layer norms - bf16, fp32, optimizer states on restart

#277 - Thomas/olruwase/sync layer norms

Author

thomasw21

thomasw21

Parents

Loading