DeepSpeed
Raise clear error on in-place GatheredParameters edits without modifier_rank
#7817
Merged

Raise clear error on in-place GatheredParameters edits without modifier_rank #7817

tohtana
improve error raised by modifying param in GatheredParameters context
a9265ae9
check in fix in partition_parameters
b95cd423
tohtana tohtana requested a review from tjruwase tjruwase 235 days ago
tohtana tohtana requested a review from loadams loadams 235 days ago
tohtana tohtana changed the title Tohtana/gather param mutation Raise clear error on in-place GatheredParameters edits without modifier_rank 235 days ago
get device from accelerator
b178f5ae
check backend to match device
02139573
check mutation only when process group size > 1
2ab4c498
add api to get backend
9582f499
tohtana tohtana requested a review from GuanhuaWang GuanhuaWang 234 days ago
simplify choosing dvice
4ef7e0ee
revert tests and add assertion
c3f5f700
remove deprecated change
0a8b3fc7
catch all errors in free_param instead of detecting changes
35f516d2
loadams
loadams approved these changes on 2026-01-28
tohtana tohtana merged d9f3d40a into master 233 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone