Megatron-DeepSpeed
d2aa4f18 - add the test script

Login via GitHub
Home
Pricing
FAQ
Install

Login via GitHub

Commit

3 years ago

add the test script

References

#274 - Sync 4 layer norms - bf16, fp32, optimizer states on restart

Author

stas00

stas00

Parents

FAQ Terms Privacy Refunds Impressum

Loading