PR #14253 [deepspeed] zero inference

[deepspeed] zero inference #14253

stas00 merged 8 commits into huggingface:master from stas00:ds-zero-inference

[deepspeed] zero inference

028d868c

only z3 makes sense for inference

5c1011ff

fix and style

ad4395ba

docs

6d3be9bf

rework

02601529

fix test

4bbd4c70

stas00 marked this pull request as ready for review 4 years ago

sgugger approved these changes on 2021-11-20

Apply suggestions from code review

1cd19d3a

responding to suggestions

0a947486

stas00 merged 956a4831 into master 4 years ago

stas00 deleted the ds-zero-inference branch 4 years ago

Reviewers

sgugger

Assignees

No one assigned

Labels

None yet

Milestone

No milestone