DeepSpeed
Stop tracking backward chain of broadcast (ZeRO3)
#5113
Merged

Stop tracking backward chain of broadcast (ZeRO3) #5113

tjruwase merged 1 commit into master from tohtana/bcast_warning_z3
tohtana
stop tracking backward chain of broadcast (z3)
f6f32023
tohtana tohtana marked this pull request as ready for review 2 years ago
tohtana tohtana requested a review from tjruwase tjruwase 2 years ago
tohtana tohtana requested a review from mrwyattii mrwyattii 2 years ago
tjruwase
tjruwase approved these changes on 2024-02-12
tjruwase tjruwase merged f295aea0 into master 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone