microsoft/DeepSpeed

Pull Requests Commits

Fix cpu-adam AVX performance (#1637)

RezaYazdaniAminabadi committed 3 years ago

Verified 259936a7

Add tensor methods in flops counting and separate macs and flops (#1591)

cli99 committed 3 years ago

Verified 082f392a

[testing] 3x faster unit tests (#1636)

jeffra committed 3 years ago

Verified 7f58853c

Refactor ZeRO naming to reduce confusion (#1607)

jeffra committed 3 years ago

Verified 1d295ff5

sharded_moe: make top1gating ONNX-exportable (#1578)

garymm committed 3 years ago

Verified 07887f66

use py-cpuinfo to detect SIMD_WIDTH in platform-independent way (#1616)

lostmsu committed 3 years ago

Verified 64c2946a

remove print (#1626)

awan-10 committed 3 years ago

Verified feb6afb0

MoE for NLG tutorial (#1633)

conglongli committed 3 years ago

Verified c6ace162

[docs] update readme (#1632)

jeffra committed 3 years ago

Verified 88d26e0b

[docs] add MoE NLG announcement to news

jeffra committed 3 years ago

df9e064d

MoE for NLG announcement (#1628)

jeffra committed 3 years ago

Verified 3ffeaa49

Control ds_report output (#1622)

tjruwase committed 3 years ago

Verified 91e15593

[readme] remove stats badge until PyPI is fixed

jeffra committed 3 years ago

Verified 3488b8cd

Sparse Attention: Fix Triton errors (#1608)

pwstegman committed 3 years ago

Verified cda7c718

[zero-3] set default device during zero.Init (#1605)

jeffra committed 3 years ago

Verified 4b854a37

Transformer kernel/fix layer norm (#1587)

RezaYazdaniAminabadi committed 3 years ago

Verified 8e891aa5

Improve pre-commit hooks (#1602)

aphedges committed 3 years ago

Verified fc2f378e

jeffra committed 3 years ago

8159c1bc

Remove unused import of ssl.OP_ENABLE_MIDDLEBOX_COMPAT (#1601)

aphedges committed 3 years ago

Verified 9aa288d7

force set lf instead of crlf (https://github.com/pre-commit/pre-commit-hooks#mixed-line-ending) (#1598)

jeffra committed 3 years ago

Verified a10e4811

Update engine.py (#1596)

PeiqiWang committed 3 years ago

Verified c3f1d82b

port OVERFLOW log to ZeRO-2 (#1593)

stas00 committed 3 years ago

Verified 7a132a9f

allreduce_always_fp16 (#1487)

Dipet committed 3 years ago

Verified d14baad9

allow external control of gradient accumulation boundary (#1588)

jeffra committed 3 years ago

Verified 52c7889b

fix partition activations issue when mp=2 and pp=2 (#1589)

eltonzheng committed 3 years ago

Verified 51d42ab9

Fix return code on error (#1540)

Dipet committed 3 years ago

Verified 499800ca

Enable AVX256 on AMD CPU (#1360)

fumihwh committed 3 years ago

Verified a637cc2c

Removing `ImportError` from tutel import try/except (#1583)

alexandremuzio committed 3 years ago

Verified 1bc13fe8

Replace brute force and add log (#1560)

chunyang-wen committed 3 years ago

Verified e2b39ded

Add documentation for TensorBoard logging (#1577)

manuelciosici committed 3 years ago

Verified e1b4aa8f

Newer Older