DeepSpeed
skip torch.zeros and tensor.copy_ when model parallel is not used
#2479
Merged
Overview
Commits
5
Changes
View On GitHub

skip torch.zeros and tensor.copy_ when model parallel is not used #2479

tjruwase merged 5 commits into deepspeedai:master from guoyejun:checkpointing2
guoyejun
guoyejun guoyejun requested a review from jeffra jeffra 3 years ago
guoyejun guoyejun requested a review from samyam samyam 3 years ago
guoyejun guoyejun requested a review from tjruwase tjruwase 3 years ago
guoyejun guoyejun requested a review from ShadenSmith ShadenSmith 3 years ago
guoyejun guoyejun requested a review from conglongli conglongli 3 years ago
guoyejun guoyejun requested a review from awan-10 awan-10 3 years ago
guoyejun guoyejun requested a review from cli99 cli99 3 years ago
guoyejun guoyejun requested a review from eltonzheng eltonzheng 3 years ago
guoyejun guoyejun requested a review from minjiaz minjiaz 3 years ago
guoyejun guoyejun requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
guoyejun guoyejun requested a review from duli2012 duli2012 3 years ago
guoyejun guoyejun requested a review from mrwyattii mrwyattii 3 years ago
guoyejun guoyejun requested a review from yaozhewei yaozhewei 3 years ago
guoyejun guoyejun requested a review from arashb arashb 3 years ago
guoyejun guoyejun requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
guoyejun guoyejun requested a review from samadejacobs samadejacobs 3 years ago
guoyejun guoyejun requested a review from cmikeh2 cmikeh2 3 years ago
guoyejun guoyejun requested a review from GuanhuaWang GuanhuaWang 3 years ago
tjruwase
tjruwase approved these changes on 2022-11-07
guoyejun
tjruwase
guoyejun
guoyejun guoyejun force pushed from a405c026 to 78b9121a 3 years ago
guoyejun guoyejun force pushed from 59d4ecdd to 150df3a9 3 years ago
guoyejun
guoyejun guoyejun force pushed from 150df3a9 to 5375933c 3 years ago
guoyejun skip torch.zeros and tensor.copy_ when model parallel is not used
82831afe
guoyejun guoyejun force pushed from c9d1ff59 to 82831afe 3 years ago
guoyejun
tjruwase Merge branch 'master' into checkpointing2
e6c2781b
tjruwase
tjruwase Merge branch 'master' into checkpointing2
19bb9002
tjruwase Merge branch 'master' into checkpointing2
7aaad6e1
guoyejun
tjruwase Merge branch 'master' into checkpointing2
1db711d2
tjruwase tjruwase merged b08cf416 into master 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum