zero.Init() should pin params in GPU memory as requested #2953
tjruwase
merged
35 commits into
master
from
olruwase/zero_infer_partial_offload
Persist params in zero.Init
4a5eb112
Disable debug prints
99d613c4
Merge branch 'master' of github.com:microsoft/DeepSpeed into olruwase…
dc1669cb
Formatting
39d0b09c
Merge branch 'master' into olruwase/zero_infer_partial_offload
aa19bd58
Merge branch 'master' into olruwase/zero_infer_partial_offload
a7fde244
Avoid offloading persisted params
9ac2a7c7
Merge branch 'olruwase/zero_infer_partial_offload' of github.com:micr…
254ea3cb
Merge branch 'master' into olruwase/zero_infer_partial_offload
d4652bd8
Merge branch 'olruwase/zero_infer_partial_offload' of github.com:micr…
b367b9c3
Simplify world_size=1
598a96bd
Formatting
d22cccec
Remove pdb
a87f9211
Merge branch 'master' into olruwase/zero_infer_partial_offload
42a22e41
Merge branch 'master' into olruwase/zero_infer_partial_offload
23f49fbd
Merge branch 'master' into olruwase/zero_infer_partial_offload
4448e58b
Restructure
e119c243
Merge branch 'olruwase/zero_infer_partial_offload' of github.com:micr…
a68ce1d3
Merge branch 'master' into olruwase/zero_infer_partial_offload
964bf49b
Merge branch 'master' into olruwase/zero_infer_partial_offload
618caa54
Merge branch 'master' into olruwase/zero_infer_partial_offload
881afff9
Formating
8baf2a58
Formatting
83a84f08
Merge branch 'olruwase/zero_infer_partial_offload' of github.com:micr…
80767e50
Merge branch 'master' into olruwase/zero_infer_partial_offload
19b50479
Merge branch 'olruwase/zero_infer_partial_offload' of github.com:micr…
da3e03d2
Apply persistence only if ds_config available
8aaa42c5
Fix typo
1a4ac0ec
add util function for getting pydantic config default values
b343c852
mrwyattii
approved these changes
on 2023-03-29
Merge branch 'master' into olruwase/zero_infer_partial_offload
f028b6d1
Merge branch 'master' into olruwase/zero_infer_partial_offload
8fbeb939
Merge branch 'master' into olruwase/zero_infer_partial_offload
d4d1eaba
Merge branch 'master' into olruwase/zero_infer_partial_offload
a61a79ef
Merge branch 'master' into olruwase/zero_infer_partial_offload
daa1321a
Merge branch 'master' into olruwase/zero_infer_partial_offload
e5869d21
Login to write a write a comment.
Login via GitHub