microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into inference/fix-masking

jeffra committed 3 years ago

Verified 69d98ad3

Unify use f str (#1511)

chunyang-wen committed 3 years ago

Verified df5b0884

Merge branch 'master' into inference/fix-masking

jeffra committed 3 years ago

Verified f2c6267d

[code readability] pipe (#1510)

stas00 committed 3 years ago

Verified bf1725bb

Merge branch 'master' into inference/fix-masking

jeffra committed 3 years ago

Verified 06d1ec86

Remove redundant pass (#1509)

chunyang-wen committed 3 years ago

Verified 85ce85dd

Bfloat16 zero2 (#1398)

raamjad committed 3 years ago

Verified 648f7bfa

Merge branch 'master' into inference/fix-masking

RezaYazdaniAminabadi committed 3 years ago

Verified 8505717c

Transformer kernel - fix unit test (#1503)

RezaYazdaniAminabadi committed 3 years ago

Verified 2c5bba6d

Merge branch 'master' into inference/fix-masking

RezaYazdaniAminabadi committed 3 years ago

Verified 150ed0b1

ZeRO3, improved parameter all-gather operation (#1188)

zarzen committed 3 years ago

Verified c0eeb69d

update CL doc (#1506)

conglongli committed 3 years ago

Verified 7f5a3add

Merge branch 'master' into inference/fix-masking

RezaYazdaniAminabadi committed 3 years ago

Verified 68825a93

allow passing hostfile to ds_ssh (#1504)

jeffra committed 3 years ago

Verified 163f568f

Fixing the transformer APIs to return tuple as the output (if needed) (#1491)

RezaYazdaniAminabadi committed 3 years ago

Verified ee6a92c0

Merge branch 'master' into inference/fix-masking

RezaYazdaniAminabadi committed 3 years ago

Verified 7507d226

[docs] Update DSE Megatron links (#1500)

tjruwase committed 3 years ago

Verified a4fff53d

Merge branch 'master' into inference/fix-masking

jeffra committed 3 years ago

Verified c308e13a

jeffra committed 3 years ago

abf066a7

Fix OneCycleLR zero division error (#1498)

AnesBenmerzoug committed 3 years ago

Verified db5d8ba2

Fix typo (#1501)

manuelciosici committed 3 years ago

Verified e976accb

enable/disable moe token dropping. (#1492)

awan-10 committed 3 years ago

Verified 56635d5b

Synchronize folder creation; Single latest file writer (#1486)

tjruwase committed 3 years ago

Verified 99bd592d

fixing the softmax masking when using triangular masking

Reza Yazdani committed 3 years ago

e747052c

fixing the softmax masking when using triangular masking

Reza Yazdani committed 3 years ago

f7ef4b5e

fix read-the-docs based on this issue: https://github.com/sphinx-doc/sphinx/issues/9727 (#1489)

jeffra committed 3 years ago

Verified 24dd285f

Proposal of how we might use sparse tensors for gradients (#1484)

Dipet committed 3 years ago

Verified fcb3ca5e

Add cpu adagrad (#1358)

fumihwh committed 3 years ago

Verified 8abdaee2

add moe+zero ckpt unit test. (#1429)

awan-10 committed 3 years ago

Verified 0b77d1d9

conglongli committed 3 years ago

Verified 29bee73f

Older