DeepSpeed
only override forward if using cuda-graph
#2291
Merged

only override forward if using cuda-graph #2291

jeffra merged 12 commits into master from fix-multigpu-hf422
jeffra
jeffra only override forward if using cuda-graph
65adc005
jeffra jeffra requested a review from samyam samyam 3 years ago
jeffra jeffra requested a review from tjruwase tjruwase 3 years ago
jeffra jeffra requested a review from ShadenSmith ShadenSmith 3 years ago
jeffra jeffra requested a review from conglongli conglongli 3 years ago
jeffra jeffra requested a review from awan-10 awan-10 3 years ago
jeffra jeffra requested a review from cli99 cli99 3 years ago
jeffra jeffra requested a review from eltonzheng eltonzheng 3 years ago
jeffra jeffra requested a review from minjiaz minjiaz 3 years ago
jeffra jeffra requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
jeffra jeffra requested a review from duli2012 duli2012 3 years ago
jeffra jeffra requested a review from mrwyattii mrwyattii 3 years ago
jeffra jeffra requested a review from yaozhewei yaozhewei 3 years ago
jeffra jeffra requested a review from arashb arashb 3 years ago
jeffra jeffra requested a review from xiaoxiawu-microsoft xiaoxiawu-microsoft 3 years ago
jeffra jeffra requested a review from samadejacobs samadejacobs 3 years ago
jeffra jeffra requested a review from cmikeh2 cmikeh2 3 years ago
jeffra override forward if cuda graph enabled
94bbe8b3
jeffra Merge branch 'master' into fix-multigpu-hf422
e74158ea
RezaYazdaniAminabadi
RezaYazdaniAminabadi approved these changes on 2022-09-08
jeffra remove fwd override
8f2db03b
jeffra Merge branch 'master' into fix-multigpu-hf422
c9a16f26
jeffra use latest HF in inf test
eef3fd16
jeffra turn off CG for MP tests
f787b340
jeffra Merge branch 'master' into fix-multigpu-hf422
509d9e17
jeffra Merge branch 'master' into fix-multigpu-hf422
d9bfabb4
jeffra swap gpt2 for gpt_neo in mp tests
6da9f1d2
jeffra rename gpt-neo id
40d4d0f9
jeffra jeffra requested a review from GuanhuaWang GuanhuaWang 3 years ago
jeffra Merge branch 'master' into fix-multigpu-hf422
32548e8f
jeffra jeffra merged cf638be9 into master 3 years ago
jeffra jeffra deleted the fix-multigpu-hf422 branch 3 years ago

Login to write a write a comment.

Login via GitHub