DeepSpeed
01ccf331 - Allow users to set/override sp comm data type from ds config

Commit

2 years ago

Allow users to set/override sp comm data type from ds config

References

#4530 - Fix the sequence-parallelism for the dense model architecture

Author

samadejacobs

samadejacobs

Parents

Loading