DeepSpeed
fix ZeRO++ convergence test
#5061
Merged
Overview
Commits
6
Changes
View On GitHub

fix ZeRO++ convergence test #5061

loadams merged 6 commits into deepspeedai:master from yundai424:master
yundai424
yundai424 update doc to migrate `init_inference` from `mp_size` to `tensor_para…
5f7f6fab
mrwyattii Merge branch 'master' into master
f2dc06e4
yundai424 Merge branch 'microsoft:master' into master
5cd88f4d
yundai424 fix zeroPP convergence test
77337c19
yundai424 yundai424 requested a review from mrwyattii mrwyattii 1 year ago
yundai424 yundai424 requested a review from tjruwase tjruwase 1 year ago
yundai424 yundai424 requested a review from loadams loadams 1 year ago
yundai424 yundai424 changed the title [minor] fix ZEROPP convergence test [xs] fix ZEROPP convergence test 1 year ago
HeyangQin
HeyangQin approved these changes on 2024-02-02
loadams Merge branch 'master' into master
1a1bb015
loadams Merge branch 'master' into master
637d16d8
loadams loadams enabled auto-merge 1 year ago
loadams loadams merged 688239e3 into master 1 year ago
yundai424 yundai424 changed the title [xs] fix ZEROPP convergence test fix ZEROPP convergence test 1 year ago
yundai424 yundai424 changed the title fix ZEROPP convergence test fix ZeRO++ convergence test 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum