microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into fix-flops-profiler

cli99 committed 3 years ago

Verified cb770a41

Codeowner addendum and fix to small model debugging script (#2076)

samadejacobs committed 3 years ago

Verified 50a652e7

Fix partition id in the fp32->fp16 param copying step for z2+cpu-offload (#2059)

siddharth9820 committed 3 years ago

Verified b3388e14

Check for bf16 support only if CUDA is available (#2049)

aphedges committed 3 years ago

Verified 3540ce74

[docs] fix broken read-the-docs build (#2075)

jeffra committed 3 years ago

Verified 559fb8e5

Comments for better understanding of zero stage1_2 (#2027)

kisseternity committed 3 years ago

Verified 9305916d

add ds inference paper (#2072)

jeffra committed 3 years ago

Verified 9fc4e5f1

Merge branch 'master' into fix-flops-profiler

tjruwase committed 3 years ago

Verified a62efb6d

Comms Benchmarks (#2040)

Quentin-Anthony committed 3 years ago

Verified 9b70ce56

Fix missing import in replace_module.py (#2050)

aphedges committed 3 years ago

Verified 76ea0534

correct partition_id in fp32 param -> fp16 param for MoE+z2 (#2058)

siddharth9820 committed 3 years ago

Verified 38a00bee

remove require grad in params count

cli99 committed 3 years ago

12e931d7

Fix for AMD unit tests (#2047)

mrwyattii committed 3 years ago

Verified 7bae53d1

Fix the half-precision version of CPU-Adam (#2032)

RezaYazdaniAminabadi committed 3 years ago

Verified a04480e1

Add compression papers (#2042)

conglongli committed 3 years ago

Verified ff87c4e1

fixed print statement (#2038)

mrwyattii committed 3 years ago

Verified 52181779

Split parameter offload from z3 (#2009)

tjruwase committed 3 years ago

Verified 678c3fe3

Retain available params until last use (#2016)

tjruwase committed 3 years ago

Verified 2a1a4096

Fix inference unit test import error catching (#2024)

mrwyattii committed 3 years ago

Verified ec1ec204

fix import errors (#2026)

KMFODA committed 3 years ago

Verified 735406e5

Use partition size (#2011)

tjruwase committed 3 years ago

Verified d86a2de9

DeepSpeed Monitor Module (Master) (#2013)

Quentin-Anthony committed 3 years ago

Verified c87f6ee2

DataLoader Length Fix (#1718)

Sanger2000 committed 3 years ago

Verified ae198e20

Fix transformer API for training-evaluation pipeline (#2018)

RezaYazdaniAminabadi committed 3 years ago

Verified 5dce73fa

DeepSpeed examples refresh (#2021)

jeffra committed 3 years ago

Verified 7c3344e2

[inference] test suite for ds-kernels (bert, roberta, gpt2, gpt-neo, gpt-j) (#1992)

jeffra committed 3 years ago

Verified b666d5cd

[CI] force upgrade HF dependencies & output py env (#2015)

jeffra committed 3 years ago

Verified e6f444ae

update CODEOWNERS (#2017)

conglongli committed 3 years ago

Verified 117c9cdf

Relax assertion to allow Megatron-DeepSpeed MoE to use ZeRO-1 (#2007)

Quentin-Anthony committed 3 years ago

Verified 25b2fc29

DeepSpeed comm backend v1 (#1985)

awan-10 committed 3 years ago

Verified 36ad3119

Older