DeepSpeed
Pass correct node size for ZeRO++
#4085
Merged
Overview
Commits
4
Changes
View On GitHub

Pass correct node size for ZeRO++ #4085

cmikeh2 merged 4 commits into master from cholmes/reduce-quantized-gpus
cmikeh2
Pass correct node size
80cca640
cmikeh2 cmikeh2 requested a review from awan-10 awan-10 2 years ago
cmikeh2 cmikeh2 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 2 years ago
cmikeh2 cmikeh2 requested a review from jeffra jeffra 2 years ago
cmikeh2 cmikeh2 requested a review from arashb arashb 2 years ago
cmikeh2 cmikeh2 requested a review from samadejacobs samadejacobs 2 years ago
cmikeh2 Merge branch 'master' into cholmes/reduce-quantized-gpus
dfd0b3c0
cmikeh2 cmikeh2 enabled auto-merge 2 years ago
samadejacobs
samadejacobs approved these changes on 2023-08-03
mrwyattii formatting
3462303f
mrwyattii Merge branch 'master' into cholmes/reduce-quantized-gpus
bf4a7784
cmikeh2 cmikeh2 merged f0463b4d into master 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum