DeepSpeed
Reducing the memory-overhead of creating large-models for multi-GPU run
#1244
Merged
Overview
Commits
3
Changes
View On GitHub

Reducing the memory-overhead of creating large-models for multi-GPU run #1244

RezaYazdaniAminabadi merged 3 commits into master from reyazda/large-model-inference
RezaYazdaniAminabadi
Reducing the memory-overhead of creating model for multi-GPU run
c5653b4a
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from awan-10 awan-10 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from cli99 cli99 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from conglongli conglongli 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from eltonzheng eltonzheng 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from jeffra jeffra 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from minjiaz minjiaz 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from niumanar niumanar 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from samyam samyam 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from ShadenSmith ShadenSmith 4 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from tjruwase tjruwase 4 years ago
jeffra
jeffra approved these changes on 2021-07-20
acostin1
hyunwoongko
switiz
aphedges
jeffra Merge branch 'master' into reyazda/large-model-inference
62bb27e7
RezaYazdaniAminabadi Merge branch 'master' into reyazda/large-model-inference
538b5400
RezaYazdaniAminabadi RezaYazdaniAminabadi merged 49b6a632 into master 4 years ago
mrwyattii mrwyattii deleted the reyazda/large-model-inference branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum