Megatron-DeepSpeed
89ab0b72 - Row column bias should be synchronized as well

Login via GitHub
Home
Pricing
FAQ
Install

Login via GitHub

Commit

3 years ago

Row column bias should be synchronized as well

References

#271 - Sync layer norm

Author

thomasw21

thomasw21

Parents

FAQ Terms Privacy Refunds Impressum

Loading