DeepSpeed
Add Ulysses DistributedAttention compatibility
#5525
Merged
Overview
Commits
5
Changes
View On GitHub

Add Ulysses DistributedAttention compatibility #5525

loadams merged 5 commits into deepspeedai:master from add-ulysses-DistributedAttention-compatibility
Kwen-Chen
Add Ulysses DistributedAttention compatibility
bca1a9e5
Kwen-Chen Kwen-Chen requested a review from mrwyattii mrwyattii 1 year ago
Kwen-Chen Kwen-Chen closed this 1 year ago
Kwen-Chen Kwen-Chen reopened this 1 year ago
Kwen-Chen Merge branch 'master' into add-ulysses-DistributedAttention-compatibi…
984d2fbc
samadejacobs
samadejacobs approved these changes on 2024-05-14
tjruwase Merge branch 'master' into add-ulysses-DistributedAttention-compatibi…
0cf487df
Kwen-Chen Merge branch 'master' into add-ulysses-DistributedAttention-compatibi…
2023ff42
loadams Merge branch 'master' into add-ulysses-DistributedAttention-compatibi…
bbccb775
loadams loadams merged f86824be into master 1 year ago
Kwen-Chen Kwen-Chen deleted the add-ulysses-DistributedAttention-compatibility branch 1 year ago
xs1997zju

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum