DeepSpeed
SP Comm-optimization: fuse query, key, and value all-2-all for better SP perforamnce
#4735

Open

SP Comm-optimization: fuse query, key, and value all-2-all for better SP perforamnce #4735

RezaYazdaniAminabadi wants to merge 1 commit into master from sp/comm-opt

fuse query, key, and value all-2-all for better SP perforamnce

bfcf5a9d

RezaYazdaniAminabadi requested a review from

jeffra 2 years ago

Reviewers

jeffra

Assignees

No one assigned

Labels

None yet

Milestone

No milestone