microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into olruwase/nvme_finetune

tjruwase committed 3 years ago

Verified 51f817f9

[ds-inference] fix progress bar (#2286)

stas00 committed 3 years ago

Verified b146aa35

Merge branch 'master' into olruwase/nvme_finetune

tjruwase committed 3 years ago

Verified 1b2ab39b

Refactor universal checkpointing and tensor fragments (#2253)

tjruwase committed 3 years ago

Verified 53182531

Fp32 accuracy bug fix (#2285)

RezaYazdaniAminabadi committed 3 years ago

Verified 47e030f5

Merge branch 'master' into olruwase/nvme_finetune

tjruwase committed 3 years ago

Verified aed6eaf7

Memory Access Utility (#2276)

cmikeh2 committed 3 years ago

Verified c84bca37

Merge branch 'master' into olruwase/nvme_finetune

tjruwase committed 3 years ago

Verified de464737

Offload all gradients to nvme

tjruwase committed 3 years ago

843821fb

Add to codeowners file (#2279)

cmikeh2 committed 3 years ago

Verified 5505e247

add a new unit test for cuda ops (#2278)

awan-10 committed 3 years ago

Verified 91eba15a

Ds-inference Int8 support through ZeroQuant technology (#2217)

RezaYazdaniAminabadi committed 3 years ago

Verified afdc7287

prevent torch ext folder mkdir at tmp (#2274)

jeffra committed 3 years ago

Verified 088212a7

Trajepl: nebula load fix (#2182)

trajepl committed 3 years ago

Verified aca34a9b

Ds inference/fix mp2 (#2270)

RezaYazdaniAminabadi committed 3 years ago

Verified d154cc0f

Fix OrderedDict import for python3.6 (#2267)

Dipet committed 3 years ago

Verified 4671cce5

Update replace_module.py, test-gptj.py related fix (#2269)

molly-smith committed 3 years ago

Verified a7ee688a

Add blob storage to CI runners (#2260)

mrwyattii committed 3 years ago

Verified 55b7b9e0

jeffra committed 3 years ago

220e5088

fix #2240: wrong time unit in flops_profiler (#2241)

yzs981130 committed 3 years ago

Verified 80f94c10

Update half precision header guards (#2261)

cmikeh2 committed 3 years ago

Verified 2a644488

Correctly detect CPU optimizer usage (#2257)

tjruwase committed 3 years ago

Verified cb5e05fe

Enable contiguous gradients with Z1+MoE (#2250)

siddharth9820 committed 3 years ago

Verified b288cf1b

jeffra committed 3 years ago

ebed51df

fix ds-inference without policy (#2247)

RezaYazdaniAminabadi committed 3 years ago

Verified c35bfe89

Make OPT policy backward compatible with pre-OPT transformers versions (#2254)

arashb committed 3 years ago

Verified fae896ef

Refactor dist tests: Checkpointing (#2202)

tjruwase committed 3 years ago

Verified 217338be

update videos (#2249)

jeffra committed 3 years ago

Verified 86164c48

Correctly detect zero_offload (#2213)

tjruwase committed 3 years ago

Verified a9b3bfa2

allow saving ckpt w/o ckpt json + bloom copy fix (#2237)

jeffra committed 3 years ago

Verified dce3acaa

Older