microsoft/DeepSpeed

Pull Requests Commits

fix the top1gating logic when use_rts is set to false

Reza Yazdani committed 3 years ago

7a459056

follow-up to #1652, resolved a100-80gb issue (#1655)

jeffra committed 3 years ago

Verified d93d924a

add backup cpu-arch detection if py-cpuinfo fails (#1652)

jeffra committed 3 years ago

Verified cbd68dc4

New feature contribution guideline (#1646)

conglongli committed 3 years ago

Verified 752319c7

Add torchvision to requirements-dev.txt (#1642)

aphedges committed 3 years ago

Verified 8bbf081a

Updating autotuner readme file to add hyperparameter adjustment suggestions (#1641)

minjiaz committed 3 years ago

Verified f2c433f0

Fix cpu-adam AVX performance (#1637)

RezaYazdaniAminabadi committed 3 years ago

Verified 259936a7

Add tensor methods in flops counting and separate macs and flops (#1591)

cli99 committed 3 years ago

Verified 082f392a

[testing] 3x faster unit tests (#1636)

jeffra committed 3 years ago

Verified 7f58853c

Refactor ZeRO naming to reduce confusion (#1607)

jeffra committed 3 years ago

Verified 1d295ff5

sharded_moe: make top1gating ONNX-exportable (#1578)

garymm committed 3 years ago

Verified 07887f66

use py-cpuinfo to detect SIMD_WIDTH in platform-independent way (#1616)

lostmsu committed 3 years ago

Verified 64c2946a

remove print (#1626)

awan-10 committed 3 years ago

Verified feb6afb0

MoE for NLG tutorial (#1633)

conglongli committed 3 years ago

Verified c6ace162

[docs] update readme (#1632)

jeffra committed 3 years ago

Verified 88d26e0b

[docs] add MoE NLG announcement to news

jeffra committed 3 years ago

df9e064d

MoE for NLG announcement (#1628)

jeffra committed 3 years ago

Verified 3ffeaa49

Control ds_report output (#1622)

tjruwase committed 3 years ago

Verified 91e15593

[readme] remove stats badge until PyPI is fixed

jeffra committed 3 years ago

Verified 3488b8cd

Sparse Attention: Fix Triton errors (#1608)

pwstegman committed 3 years ago

Verified cda7c718

[zero-3] set default device during zero.Init (#1605)

jeffra committed 3 years ago

Verified 4b854a37

Transformer kernel/fix layer norm (#1587)

RezaYazdaniAminabadi committed 3 years ago

Verified 8e891aa5

Improve pre-commit hooks (#1602)

aphedges committed 3 years ago

Verified fc2f378e

jeffra committed 3 years ago

8159c1bc

Remove unused import of ssl.OP_ENABLE_MIDDLEBOX_COMPAT (#1601)

aphedges committed 3 years ago

Verified 9aa288d7

force set lf instead of crlf (https://github.com/pre-commit/pre-commit-hooks#mixed-line-ending) (#1598)

jeffra committed 3 years ago

Verified a10e4811

Update engine.py (#1596)

PeiqiWang committed 3 years ago

Verified c3f1d82b

port OVERFLOW log to ZeRO-2 (#1593)

stas00 committed 3 years ago

Verified 7a132a9f

allreduce_always_fp16 (#1487)

Dipet committed 3 years ago

Verified d14baad9

allow external control of gradient accumulation boundary (#1588)

jeffra committed 3 years ago

Verified 52c7889b

Older