DeepSpeed
Add and Remove ZeRO 3 Hooks
#5658
Merged

Add and Remove ZeRO 3 Hooks #5658

jomayeri merged 20 commits into master from jomayeri/zero3-hooks
jomayeri
adding hooks context manager
d36ecdf0
jomayeri jomayeri requested a review from tjruwase tjruwase 1 year ago
jomayeri jomayeri requested a review from mrwyattii mrwyattii 1 year ago
jomayeri Merge branch 'master' into jomayeri/zero3-hooks
93bd49e5
tjruwase
jomayeri format changes
318929c8
tjruwase tjruwase requested a review from tohtana tohtana 1 year ago
tjruwase tjruwase removed review request from mrwyattii mrwyattii 1 year ago
tjruwase Merge branch 'master' into jomayeri/zero3-hooks
6b75fcac
tjruwase
tjruwase commented on 2024-06-18
tjruwase
tjruwase commented on 2024-06-18
tjruwase
tjruwase commented on 2024-06-18
jomayeri Merge branch 'master' into jomayeri/zero3-hooks
daca2363
jomayeri running precommit checks
63fa13ca
jomayeri jomayeri requested a review from awan-10 awan-10 1 year ago
jomayeri jomayeri requested a review from arashb arashb 1 year ago
jomayeri Merge branch 'master' into jomayeri/zero3-hooks
be067aeb
HeyangQin Merge branch 'master' into jomayeri/zero3-hooks
65d66993
jomayeri remove circular dependency
00870e32
jomayeri jomayeri requested a review from loadams loadams 1 year ago
tjruwase
tjruwase commented on 2024-07-16
tjruwase
tjruwase commented on 2024-07-16
tjruwase
tjruwase commented on 2024-07-16
jomayeri adding unwrap unittest
3dd6ebe8
jomayeri Merge branch 'master' into jomayeri/zero3-hooks
a71bb005
jomayeri Merge branch 'master' into jomayeri/zero3-hooks
bfb86ff1
jomayeri tests and precommit
b3405f0e
tjruwase Merge branch 'master' into jomayeri/zero3-hooks
c10cca77
jomayeri Merge branch 'master' into jomayeri/zero3-hooks
b1dc01b4
jomayeri format changes
153ccd6e
loadams Merge branch 'master' into jomayeri/zero3-hooks
aa09c083
loadams Update formatting
5e0be490
tjruwase
tjruwase approved these changes on 2024-08-07
tjruwase
tjruwase commented on 2024-08-07
tjruwase Merge branch 'master' into jomayeri/zero3-hooks
7c4ffcbd
tjruwase Merge branch 'master' into jomayeri/zero3-hooks
2cf0b14a
tjruwase
jomayeri jomayeri merged c2e3a706 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone