microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into jeffra/z3-new-param

tjruwase committed 3 years ago

Verified c160e9d4

[readme] remove stats badge until PyPI is fixed

jeffra committed 3 years ago

Verified 3488b8cd

stash grandparent module in zero-dict to fetch later

jeffra committed 3 years ago

babd6239

Sparse Attention: Fix Triton errors (#1608)

pwstegman committed 3 years ago

Verified cda7c718

address comment, also fix old deepscale refs

jeffra committed 3 years ago

19e0dbd4

add support for new params added during fwd pass

jeffra committed 3 years ago

2e8d81a5

[zero-3] set default device during zero.Init (#1605)

jeffra committed 3 years ago

Verified 4b854a37

Transformer kernel/fix layer norm (#1587)

RezaYazdaniAminabadi committed 3 years ago

Verified 8e891aa5

Improve pre-commit hooks (#1602)

aphedges committed 3 years ago

Verified fc2f378e

jeffra committed 3 years ago

8159c1bc

Remove unused import of ssl.OP_ENABLE_MIDDLEBOX_COMPAT (#1601)

aphedges committed 3 years ago

Verified 9aa288d7

force set lf instead of crlf (https://github.com/pre-commit/pre-commit-hooks#mixed-line-ending) (#1598)

jeffra committed 3 years ago

Verified a10e4811

Update engine.py (#1596)

PeiqiWang committed 3 years ago

Verified c3f1d82b

port OVERFLOW log to ZeRO-2 (#1593)

stas00 committed 3 years ago

Verified 7a132a9f

allreduce_always_fp16 (#1487)

Dipet committed 3 years ago

Verified d14baad9

allow external control of gradient accumulation boundary (#1588)

jeffra committed 3 years ago

Verified 52c7889b

fix partition activations issue when mp=2 and pp=2 (#1589)

eltonzheng committed 3 years ago

Verified 51d42ab9

Fix return code on error (#1540)

Dipet committed 3 years ago

Verified 499800ca

Enable AVX256 on AMD CPU (#1360)

fumihwh committed 3 years ago

Verified a637cc2c

Removing `ImportError` from tutel import try/except (#1583)

alexandremuzio committed 3 years ago

Verified 1bc13fe8

Replace brute force and add log (#1560)

chunyang-wen committed 3 years ago

Verified e2b39ded

Add documentation for TensorBoard logging (#1577)

manuelciosici committed 3 years ago

Verified e1b4aa8f

remove debug prints (#1585)

stas00 committed 3 years ago

Verified bcf2bdde

jeffra committed 3 years ago

8220674d

Several fixes for our read-the-docs build (#1579)

jeffra committed 3 years ago

Verified a8a17f23

Enables ZeRO-3 inference (#1514)

jeffra committed 3 years ago

Verified 2332cb31

[CI] transformers@master has been fixed (#1573)

stas00 committed 3 years ago

Verified 74baf5bb

switch bin files to use python3 instead of python (#1185)

jeffra committed 3 years ago

Verified 236890d6

Render docs for pipe.ProcessTopology (#1505)

James Reed committed 3 years ago

Verified fafc827d

Remove hard tensorboardX requirement (#1571)

jeffra committed 3 years ago

Verified a90497ec

Older