DeepSpeed
Zero2: avoid graph breaks in torch.compile by using param_idx
#6803
Merged
Merged
Zero2: avoid graph breaks in torch.compile by using param_idx #6803
loadams
merged
12 commits into
deepspeedai:master
from
nelyahu:zero2_param_idx
Zero2: avoid graph breaks in torch.compile by using param_idx
7798d5aa
tjruwase
commented
on 2024-12-02
Update deepspeed/runtime/zero/stage_1_and_2.py
7d1c8839
Merge branch 'master' into zero2_param_idx
726deee6
tjruwase
approved these changes
on 2024-12-12
Merge branch 'master' into zero2_param_idx
9cb29d8f
Merge branch 'master' into zero2_param_idx
4bb8f918
Formatting, fix indent
f7e8d53d
loadams
commented
on 2024-12-16
Update stage_1_and_2.py
7606795a
Merge branch 'master' into zero2_param_idx
9e58c417
Merge branch 'master' into zero2_param_idx
351ca4da
Merge branch 'master' into zero2_param_idx
ef1e8ce7
Merge branch 'master' into zero2_param_idx
d99c6656
Merge branch 'master' into zero2_param_idx
377acd72
Login to write a write a comment.
Login via GitHub