DeepSpeed
3fa24208 - [zero3] fix reference counting in backward over multiple forwards (#1227)

Commit

4 years ago

[zero3] fix reference counting in backward over multiple forwards (#1227) * fix reference counting in backward over multiple forwards * test + cleanup

References

#1227 - [zero3] fix reference counting in backward over multiple forwards

Author

stas00

Parents

81039463

DeepSpeed 3fa24208 - [zero3] fix reference counting in backward over multiple forwards (#1227)

DeepSpeed
3fa24208 - [zero3] fix reference counting in backward over multiple forwards (#1227)