DeepSpeed
[ZeRO] non-MoE stage 1 requires CG disabled
#2703
Merged

[ZeRO] non-MoE stage 1 requires CG disabled #2703

jeffra merged 2 commits into master from jeffra/z1-perf-fix
jeffra
jeffra non-MoE stage 1 requires CG disabled
d3c693d1
jeffra jeffra requested a review from tjruwase tjruwase 2 years ago
siddharth9820
tjruwase Merge branch 'master' into jeffra/z1-perf-fix
573278ff
tjruwase
tjruwase approved these changes on 2023-01-16
jeffra jeffra merged e4ba7222 into master 2 years ago
jeffra jeffra deleted the jeffra/z1-perf-fix branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone