microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into fix-sparse-attn

jeffra committed 4 years ago

Verified abfe900e

Tensor-Parallelism general support (#1512)

RezaYazdaniAminabadi committed 4 years ago

Verified 9ce00a21

backward compatibility (#1549)

conglongli committed 4 years ago

Verified b16dd943

jeffra committed 4 years ago

fa9d3e84

Fix 1bit extra issue (#1542)

jeffra committed 4 years ago

Verified 2665c8b1

Use cuda tensors for allgather (#1548)

tjruwase committed 4 years ago

Verified bd3ebddf

Merge branch 'master' into fix-sparse-attn

RezaYazdaniAminabadi committed 4 years ago

Verified 544c0bc3

Reza Yazdani committed 4 years ago

d926bf75

fixing the sparse attention for low block-size

Reza Yazdani committed 4 years ago

542b25c4

CPU-Adam: Fix compile Issue (#1537)

RezaYazdaniAminabadi committed 4 years ago

Verified af443f63

Merge branch 'master' of github.com:microsoft/DeepSpeed

Reza Yazdani committed 4 years ago

fde63105

Modify inference engine (#1520)

chunyang-wen committed 4 years ago

Verified f0122007

Merge branch 'master' of github.com:microsoft/DeepSpeed

Reza Yazdani committed 4 years ago

426ecf73

[unit tests] allow unique port for tests

jeffra committed 4 years ago

0af15b98

fstr for multnode_runner (#1532)

chunyang-wen committed 4 years ago

Verified 93c71831

[docs] fix 404 (#1531)

stas00 committed 4 years ago

Verified 76f2b5e5

typo in profiler.py (#1527)

ncfrey committed 4 years ago

Verified 2c62d657

Adding Tutel to MoE layer (#1528)

alexandremuzio committed 4 years ago

Verified 2887349c

Use fstr in launcher (#1521)

chunyang-wen committed 4 years ago

Verified cf1f1601

make conv flops counting general for 1,2,3d (#1518)

cli99 committed 4 years ago

Verified f9b37801

jeffra committed 4 years ago

426dd2b5

Prevent creation of local temp directory (#1494)

aphedges committed 4 years ago

Verified 91defd7c

Unify use f str (#1511)

chunyang-wen committed 4 years ago

Verified df5b0884

[code readability] pipe (#1510)

stas00 committed 4 years ago

Verified bf1725bb

Merge branch 'master' of github.com:microsoft/DeepSpeed

Reza Yazdani committed 4 years ago

c5ecf325

Remove redundant pass (#1509)

chunyang-wen committed 4 years ago

Verified 85ce85dd

Bfloat16 zero2 (#1398)

raamjad committed 4 years ago

Verified 648f7bfa

Transformer kernel - fix unit test (#1503)

RezaYazdaniAminabadi committed 4 years ago

Verified 2c5bba6d

ZeRO3, improved parameter all-gather operation (#1188)

zarzen committed 4 years ago

Verified c0eeb69d

update CL doc (#1506)

conglongli committed 4 years ago

Verified 7f5a3add

Older