DeepSpeed
5f99fec8 - fuse query, key, and value all-2-all for better SP perforamnce

Commit

2 years ago

fuse query, key, and value all-2-all for better SP perforamnce

References

Author

Reza Yazani

Parents

Loading