DeepSpeed
9d2b71a5 - support large hidden dimensions (4K and 8K)

Commit

4 years ago

support large hidden dimensions (4K and 8K)

References

transformer-kernel/support-arbitrary-hidden

Author

Reza Yazdani

Parents

Loading