PR #4648 [Dist] Add ZeRO-1 Optimizer

[Dist] Add ZeRO-1 Optimizer #4648

JackCaoG merged 4 commits into pytorch:master from hgt312:add_zero1

JackCaoG requested a review from

Liyang90 2 years ago

miladm requested a review from

mrshenli 2 years ago

mrshenli commented on 2023-02-19

init

677e5ab5

test

1063deba

lint

6f65c5f4

hgt312 force pushed from bc082d9b to 76547181 2 years ago

hgt312 force pushed from 76547181 to 3d9fcd20 2 years ago

address comments

2b33ecd6

hgt312 force pushed from 3d9fcd20 to 2b33ecd6 2 years ago

JackCaoG merged 1d313bb0 into master 2 years ago

Reviewers

mrshenli

Liyang90

Assignees

No one assigned

Labels

None yet

Milestone

No milestone