DeepSpeed
[zero-3] add support for new params added during fwd pass
#1606

Open

[zero-3] add support for new params added during fwd pass #1606

jeffra wants to merge 4 commits into master from jeffra/z3-new-param

add support for new params added during fwd pass

2e8d81a5

jeffra requested a review from

awan-10 4 years ago

jeffra requested a review from

cli99 4 years ago

jeffra requested a review from

conglongli 4 years ago

jeffra requested a review from

eltonzheng 4 years ago

jeffra requested a review from

minjiaz 4 years ago

jeffra requested a review from

RezaYazdaniAminabadi 4 years ago

jeffra requested a review from

samyam 4 years ago

jeffra requested a review from

ShadenSmith 4 years ago

jeffra requested a review from

tjruwase 4 years ago

samyam commented on 2021-12-01

address comment, also fix old deepscale refs

19e0dbd4

tjruwase approved these changes on 2021-12-01

stash grandparent module in zero-dict to fetch later

babd6239

Merge branch 'master' into jeffra/z3-new-param

c160e9d4

jeffra requested a review from

mrwyattii 2 years ago

jomayeri assigned

jomayeri 2 years ago

Reviewers

tjruwase

samyam

awan-10

cli99

conglongli

eltonzheng

minjiaz

RezaYazdaniAminabadi

ShadenSmith

mrwyattii

Assignees

jomayeri

Labels

None yet

Milestone

No milestone

DeepSpeed [zero-3] add support for new params added during fwd pass #1606 Open

[zero-3] add support for new params added during fwd pass #1606

DeepSpeed
[zero-3] add support for new params added during fwd pass
#1606

Open