DeepSpeed
[zero3] fix reference counting in backward over multiple forwards
#1227
Merged
Overview
Commits
2
Changes
View On GitHub

[zero3] fix reference counting in backward over multiple forwards #1227

tjruwase merged 2 commits into deepspeedai:master from stas00:fix-prefetch-with-repeat-layer
stas00
stas00 fix reference counting in backward over multiple forwards
a04e568c
stas00 stas00 requested a review from awan-10 awan-10 5 years ago
stas00 stas00 requested a review from cli99 cli99 5 years ago
stas00 stas00 requested a review from conglongli conglongli 5 years ago
stas00 stas00 requested a review from eltonzheng eltonzheng 5 years ago
stas00 stas00 requested a review from jeffra jeffra 5 years ago
stas00 stas00 requested a review from minjiaz minjiaz 5 years ago
stas00 stas00 requested a review from niumanar niumanar 5 years ago
stas00 stas00 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 5 years ago
stas00 stas00 requested a review from samyam samyam 5 years ago
stas00 stas00 requested a review from ShadenSmith ShadenSmith 5 years ago
stas00 stas00 requested a review from tjruwase tjruwase 5 years ago
stas00 test + cleanup
4adf8029
stas00 stas00 changed the title [WIP] [zero3] fix reference counting in backward over multiple forwards [zero3] fix reference counting in backward over multiple forwards 5 years ago
stas00
stas00 commented on 2021-07-14
tjruwase
tjruwase approved these changes on 2021-07-14
tjruwase tjruwase merged 3fa24208 into master 5 years ago
stas00 stas00 deleted the fix-prefetch-with-repeat-layer branch 5 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum