DeepSpeed
Raise clear error on in-place GatheredParameters edits without modifier_rank
#7817
Merged

Raise clear error on in-place GatheredParameters edits without modifier_rank #7817

tohtana
tohtana improve error raised by modifying param in GatheredParameters context
a9265ae9
tohtana check in fix in partition_parameters
b95cd423
tohtana tohtana requested a review from tjruwase tjruwase 39 days ago
tohtana tohtana requested a review from loadams loadams 39 days ago
tohtana tohtana changed the title Tohtana/gather param mutation Raise clear error on in-place GatheredParameters edits without modifier_rank 39 days ago
tohtana get device from accelerator
b178f5ae
tohtana check backend to match device
02139573
tohtana check mutation only when process group size > 1
2ab4c498
tohtana add api to get backend
9582f499
tohtana tohtana requested a review from GuanhuaWang GuanhuaWang 39 days ago
tohtana simplify choosing dvice
4ef7e0ee
tohtana revert tests and add assertion
c3f5f700
tohtana remove deprecated change
0a8b3fc7
tohtana catch all errors in free_param instead of detecting changes
35f516d2
loadams
loadams approved these changes on 2026-01-28
tohtana tohtana merged d9f3d40a into master 38 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone