DeepSpeed

SP Comm-optimization: fuse query, key, and value all-2-all for better SP perforamnce

#4735

Open