DeepSpeed
Fix Ulysses PEFT test
#7784
Merged

Fix Ulysses PEFT test #7784

tohtana
tohtana fix: use mpu for Ulysses PEFT SP group check
f4e96cc2
tohtana tohtana requested a review from tjruwase tjruwase 139 days ago
tohtana tohtana requested a review from loadams loadams 139 days ago
PKUWZP PKUWZP requested a review from PKUWZP PKUWZP 138 days ago
PKUWZP
PKUWZP approved these changes on 2026-01-17
tohtana tohtana merged 491a38ce into master 138 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone