DeepSpeed
Fix uneven head sequence parallelism bug (#6774)
#6797
Merged

Fix uneven head sequence parallelism bug (#6774) #6797

loadams merged 11 commits into deepspeedai:master from Eugene29:master
Eugene29
Eugene29 Fix uneven head sequence parallelism bug (#6774)
42717372
Eugene29 Eugene29 requested a review from loadams loadams 1 year ago
Eugene29 Eugene29 requested a review from tjruwase tjruwase 1 year ago
Eugene29
inkcherry
inkcherry
inkcherry commented on 2024-12-02
Eugene29 unify booleans to use scatter_idx
8d7c06ad
loadams Merge branch 'master' into master
c6cfaf49
loadams Merge branch 'master' into master
5ec485ed
loadams Merge branch 'master' into master
d209707b
loadams Merge branch 'master' into master
68d797ae
loadams Merge branch 'master' into master
1dd1f942
loadams Merge branch 'master' into master
fd610d3f
loadams
loadams approved these changes on 2024-12-09
loadams loadams enabled auto-merge 1 year ago
loadams Merge branch 'master' into master
68691556
loadams Merge branch 'master' into master
9e76c74a
loadams Merge branch 'master' into master
4fe7f577
disabled auto-merge 1 year ago
Manually disabled by user
loadams loadams merged ecb4bf32 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone