DeepSpeed
[BUG] Fix UlyssesSPAttentionHF.register_with_transformers() crash with PEFT models
#7737
Merged
Overview
Commits
5
Changes
View On GitHub

[BUG] Fix UlyssesSPAttentionHF.register_with_transformers() crash with PEFT models #7737

stas00 merged 5 commits into deepspeedai:master from Rakshit-gen:fix/ulysses-peft-crash
Rakshit-gen
Rakshit-gen Rakshit-gen requested a review from tjruwase tjruwase 57 days ago
Rakshit-gen Rakshit-gen requested a review from tohtana tohtana 57 days ago
Rakshit-gen
Rakshit-gen Fix UlyssesSPAttentionHF crash with PEFT models
5db0c450
Rakshit-gen Rakshit-gen force pushed from 2b4c45f8 to 5db0c450 56 days ago
sfc-gh-truwase Merge branch 'master' into fix/ulysses-peft-crash
c54a1ec1
sfc-gh-truwase
sfc-gh-truwase sfc-gh-truwase requested a review from stas00 stas00 56 days ago
Rakshit-gen Add unit test for UlyssesSPAttentionHF with PEFT models
a11d2eec
Rakshit-gen Rakshit-gen requested a review from loadams loadams 56 days ago
Rakshit-gen
stas00
stas00 commented on 2025-12-19
Rakshit-gen Combine identical if/elif conditions in UlyssesSPAttentionHF
536a972a
stas00
stas00 approved these changes on 2025-12-19
stas00 stas00 enabled auto-merge (squash) 56 days ago
Rakshit-gen
stas00 Merge branch 'master' into fix/ulysses-peft-crash
1e208b01
stas00 stas00 merged b6f4e20e into master 56 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum