Enables ZeRO-3 inference #1514
add initial support for no optimizer init for Z3
bdb90686
jeffra
changed the title Add support for no optimizer init for Z3 [WIP] Add support for no optimizer init for Z3 4 years ago
add guards and clean-up
054565b6
Merge branch 'master' into jeffra/no_optim
d4b7c865
add docstring to dummy optim
7c2075a9
Merge branch 'jeffra/no_optim' of github.com:microsoft/DeepSpeed into…
c3f594a5
jeffra
marked this pull request as ready for review 4 years ago
jeffra
changed the title [WIP] Add support for no optimizer init for Z3 Allow ZeRO-3 to work without an optimizer 4 years ago
jeffra
changed the title Allow ZeRO-3 to work without an optimizer Enables ZeRO-3 inference 4 years ago
Merge branch 'master' into jeffra/no_optim
e26bc317
fix regression introduced in SimpleModel refactor
dfdf0253
Merge branch 'jeffra/no_optim' of github.com:microsoft/DeepSpeed into…
f091fd8f
Merge branch 'master' into jeffra/no_optim
901c88a0
all environ var for test port
28ed3729
Merge branch 'jeffra/no_optim' of github.com:microsoft/DeepSpeed into…
569747d6
Merge branch 'master' into jeffra/no_optim
d92c9a8a
align remote_device/pin_memory in ds config with zero.Init
16f32f6b
update test to use config
2fe7901f
tjruwase
approved these changes
on 2021-11-16
Merge branch 'master' into jeffra/no_optim
da953d3a
address comment
498af69d
Merge branch 'jeffra/no_optim' of github.com:microsoft/DeepSpeed into…
3484b6fe
fix new lines that broke diff
28988a3d
Merge branch 'master' into jeffra/no_optim
60f284d9
skip param offload test on older torch
a7140c13
Merge branch 'master' into jeffra/no_optim
346e85e9
fix import typo
3d21b50f
jeffra
enabled auto-merge (squash) 4 years ago
jeffra
merged
2332cb31
into master 4 years ago
jeffra
deleted the jeffra/no_optim branch 4 years ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub