DeepSpeed
SP Comm-optimization: fuse query, key, and value all-2-all for better SP perforamnce
#4735
Open

Loading