DeepSpeed
[zero-3] Handle forward parameter return correctly in nested cases
#2642

Merged

[zero-3] Handle forward parameter return correctly in nested cases #2642

jeffra merged 7 commits into master from ZeRO3forwardparamfix

[zero] `_apply_to_tensors_only` handle `torch.Tensor` subclasses

33eef8be

Merge branch 'master' into patch-2

aa7aaeb1

ZeRO 3 Forward Parameter return handled correctly in nested cases

b0ab349a

samyam requested a review from

jeffra 3 years ago

samyam requested a review from

tjruwase 3 years ago

samyam requested a review from

mrwyattii 3 years ago

formatting

c97adbe8

jeffra changed the title ~~Zero3forwardparamfix~~ [zero-3] Handle forward parameter return correctly in nested cases 3 years ago

Merge branch 'master' into ZeRO3forwardparamfix

b4d94b16

stas00 commented on 2022-12-22

tjruwase commented on 2022-12-22

Update deepspeed/runtime/zero/parameter_offload.py

36bb83cd

address comments

5188f0b5

tjruwase approved these changes on 2022-12-23

jeffra merged a298a43a into master 3 years ago

jeffra deleted the ZeRO3forwardparamfix branch 3 years ago

Reviewers

tjruwase

jeffra

stas00

mrwyattii

Assignees

No one assigned

Labels

None yet

Milestone

No milestone