Megatron-DeepSpeed
d64a947e - compare on cpu

Login via GitHub
Home
Pricing
FAQ
Install

Login via GitHub

Commit

3 years ago

compare on cpu

References

#274 - Sync 4 layer norms - bf16, fp32, optimizer states on restart

Author

stas00

stas00

Parents

FAQ Terms Privacy Refunds Impressum

Loading