microsoft/DeepSpeed

Pull Requests Commits

Autotuning (#1554)

cli99 committed 4 years ago

Verified 9caa74e5

Add documentation for bfloat16 (git commit 648f7bfa5009484b822064d0c28d377da6dd71a0) (#1516)

manuelciosici committed 4 years ago

Verified b7cc7c8e

Fix zinf none swapper (#1550)

tjruwase committed 4 years ago

Verified 488105eb

Add warmup_type arguments in WarmupLR and WarmupDecayLR (#1530)

skpig committed 4 years ago

Verified 76847f42

Fix sparse attention for small block-sizes (#1545)

RezaYazdaniAminabadi committed 4 years ago

Verified 3ed77304

Tensor-Parallelism general support (#1512)

RezaYazdaniAminabadi committed 4 years ago

Verified 9ce00a21

backward compatibility (#1549)

conglongli committed 4 years ago

Verified b16dd943

jeffra committed 4 years ago

fa9d3e84

Fix 1bit extra issue (#1542)

jeffra committed 4 years ago

Verified 2665c8b1

Merge branch 'master' into s3-pr

tjruwase committed 4 years ago

Verified 812fe679

Use cuda tensors for allgather (#1548)

tjruwase committed 4 years ago

Verified bd3ebddf

CPU-Adam: Fix compile Issue (#1537)

RezaYazdaniAminabadi committed 4 years ago

Verified af443f63

Modify inference engine (#1520)

chunyang-wen committed 4 years ago

Verified f0122007

[unit tests] allow unique port for tests

jeffra committed 4 years ago

0af15b98

fstr for multnode_runner (#1532)

chunyang-wen committed 4 years ago

Verified 93c71831

[docs] fix 404 (#1531)

stas00 committed 4 years ago

Verified 76f2b5e5

typo in profiler.py (#1527)

ncfrey committed 4 years ago

Verified 2c62d657

Adding Tutel to MoE layer (#1528)

alexandremuzio committed 4 years ago

Verified 2887349c

Merge branch 'master' into s3-pr

tjruwase committed 4 years ago

Verified d3ecb1fc

Use fstr in launcher (#1521)

chunyang-wen committed 4 years ago

Verified cf1f1601

Merge branch 'master' into s3-pr

tjruwase committed 4 years ago

Verified 73207aee

make conv flops counting general for 1,2,3d (#1518)

cli99 committed 4 years ago

Verified f9b37801

cleanup/fixes for fp16 partition defragmentation

Justin Chiu committed 4 years ago

bf0dd663

using base allgather params when only 1 param

Justin Chiu committed 4 years ago

806b0726

unbroke bfloat16 config after merge conflict

Justin Chiu committed 4 years ago

cc7011ec

Merge branch 'master' into s3-pr

tjruwase committed 4 years ago

Verified 38af6b18

fixed tracking for multiple param groups

Justin Chiu committed 4 years ago

16281df2

removed unused parameter offset bookkeeping

Justin Chiu committed 4 years ago

14e22a25

remove buffered_reduce_fallback

Justin Chiu committed 4 years ago

6ee558d1

changes for bwd compatibility with pytorch 1.2

Justin Chiu committed 4 years ago

e74f5099

Newer Older