microsoft/DeepSpeed

Pull Requests Commits

Formatting fixes

tjruwase committed 4 years ago

ce5d9074

Merge branch 'master' of github.com:microsoft/DeepSpeed into olruwase/zero2_grad_accum_bug

tjruwase committed 4 years ago

6a7829a1

Unit test for unbalanced gradients in ZeRO

tjruwase committed 4 years ago

e1ff8bab

Use zero-tensors for missing gradients to avoid size mismatch

tjruwase committed 4 years ago

0bb0cc80

bump version 0.3.4

jeffra committed 4 years ago

6b28bc5d

Discover variables for NCCL backend on AML without mpi4py (#542)

awan-10 committed 4 years ago

Verified 1b45917c

Fix setup.py for cpu-only environment installation (#538)

harrydrippin committed 4 years ago

Verified d81cb26d

backwards compatability w. v020 ckpts, fix issue with zero-1 ckpts (#543)

jeffra committed 4 years ago

Verified dce054db

jeffra committed 4 years ago

Verified 9de21b72

ZeRO-1 tune max-elems + bug fix (#532)

jeffra committed 4 years ago

Verified 08c96a1b

more fine-grained manifest file for includes/excludes (#540)

jeffra committed 4 years ago

Verified fdd81c30

append job-name if explicit output dir is given (#539)

jeffra committed 4 years ago

Verified 5b09be60

Fix layout bug in ZeRO Stage 1 checkpoint logic (#531)

tjruwase committed 4 years ago

Verified 7752dc5e

jeffra committed 4 years ago

9941ce75

Dependency pruning (#528)

jeffra committed 4 years ago

Verified 0dc84200

Installation documentation updates. (#525)

Shaden Smith committed 4 years ago

Verified d779bd53

ds_report bug fix on cpu and guard torch import in setup.py (#524)

jeffra committed 4 years ago

Verified ca9ab120

DeepSpeed JIT op + PyPI support (#496)

jeffra committed 4 years ago

Verified 31f46fee

Update zero.md tutorial (#495)

samyam committed 4 years ago

Verified 0ad4fd88

fix bug on non-DLTS infra when no output path set (#523)

jeffra committed 4 years ago

Verified eea1c285

PLD release (#513)

tjruwase committed 4 years ago

Verified be1147c0

updating pld docs (#517)

minjiaz committed 4 years ago

Verified e082d475

Fix PLD news url (#515)

tjruwase committed 4 years ago

Verified 41fb24b3

PLD documentation (#514)

tjruwase committed 4 years ago

Verified e351090c

Fixing CPU-Adam convergence issue (#503)

RezaYazdaniAminabadi committed 4 years ago

Verified 7d4d742b

fixing the AVX_256 compatibility (#497)

RezaYazdaniAminabadi committed 4 years ago

Verified 4c37d705

Add CPUAdam optimizer for zero-offload in deepspeed engine (#484)

RezaYazdaniAminabadi committed 4 years ago

Verified f5aa2547

updating website dependencies (#475)

Shaden Smith committed 4 years ago

Verified d720fdb6

Add support for p100 in transformer kernels (#470)

jeffra committed 4 years ago

Verified 7ddfda85

revert previous (accidental) change

jeffra committed 4 years ago

Verified 1afca8f7

Older