Megatron-DeepSpeed
0d0d84c8 - Add bias a weight we need to sync as well (#307)

Commit

3 years ago

Add bias a weight we need to sync as well (#307)

References

#307 - Add bias a weight we need to sync as well across TP

Author

thomasw21

thomasw21

Parents

Loading