deepspeedai/DeepSpeed

Pull Requests Commits

Merge branch 'master' into ds-inference/fix-mp

RezaYazdaniAminabadi committed 3 years ago

Verified 33230668

Comms Benchmarks (#2040)

Quentin-Anthony committed 3 years ago

Verified 9b70ce56

Merge branch 'master' into ds-inference/fix-mp

mrwyattii committed 3 years ago

Verified a508f261

added proper check for pytorch version to multi-gpu tests

mrwyattii committed 3 years ago

211948a0

Fix missing import in replace_module.py (#2050)

aphedges committed 3 years ago

Verified 76ea0534

Update test_inference.py

mrwyattii committed 3 years ago

Verified 002d0def

revert inference unit test workflow changes

mrwyattii committed 3 years ago

Verified 3f3437d3

Merge branch 'master' into ds-inference/fix-mp

RezaYazdaniAminabadi committed 3 years ago

Verified 5232b186

correct partition_id in fp32 param -> fp16 param for MoE+z2 (#2058)

siddharth9820 committed 3 years ago

Verified 38a00bee

Fix for AMD unit tests (#2047)

mrwyattii committed 3 years ago

Verified 7bae53d1

Fix the half-precision version of CPU-Adam (#2032)

RezaYazdaniAminabadi committed 3 years ago

Verified a04480e1

Add compression papers (#2042)

conglongli committed 3 years ago

Verified ff87c4e1

Merge branch 'ds-inference/fix-mp' of https://github.com/microsoft/DeepSpeed into ds-inference/fix-mp

mrwyattii committed 3 years ago

0962d212

improve perf regression test, disable fp32 for multi-gpu

mrwyattii committed 3 years ago

f38b764a

Merge branch 'master' into ds-inference/fix-mp

tjruwase committed 3 years ago

Verified e8af69f7

fix to avoid error on unexpected torch version

mrwyattii committed 3 years ago

150c56fd

fixed print statement (#2038)

mrwyattii committed 3 years ago

Verified 52181779

Merge branch 'master' into ds-inference/fix-mp

mrwyattii committed 3 years ago

Verified bd9f4c33

Split parameter offload from z3 (#2009)

tjruwase committed 3 years ago

Verified 678c3fe3

Retain available params until last use (#2016)

tjruwase committed 3 years ago

Verified 2a1a4096

Fix inference unit test import error catching (#2024)

mrwyattii committed 3 years ago

Verified ec1ec204

fixed formatting

mrwyattii committed 3 years ago

4d09830c

bumped inference workflow to cu113 so we test CUDA Graph

mrwyattii committed 3 years ago

4c5db332

compare outputs from each GPU on multi-gpu tests

mrwyattii committed 3 years ago

276d7c77

added multi-gpu inference unit test

mrwyattii committed 3 years ago

7bb9cd25

fix import errors (#2026)

KMFODA committed 3 years ago

Verified 735406e5

Use partition size (#2011)

tjruwase committed 3 years ago

Verified d86a2de9

Merge branch 'master' into ds-inference/fix-mp

RezaYazdaniAminabadi committed 3 years ago

Verified 31050154

Fixing several issue in API and kernels to run inference-kernels with model-parallelism

Reza Yazdani committed 3 years ago

7ac36b8d

DeepSpeed Monitor Module (Master) (#2013)

Quentin-Anthony committed 3 years ago

Verified c87f6ee2

Older