deepspeedai/DeepSpeed

Pull Requests Commits

Merge branch 'master' into olruwase/set_zero_opt_grad

tjruwase committed 2 years ago

Verified 5372ee63

Pin accelerate to fix CI failures/issues (#6610)

loadams committed 2 years ago

Verified 745dd48b

Fix SD workflow (#6609)

loadams committed 2 years ago

Verified 00c4b98b

Move V100 workflows from cuda 11.1/11.7 to 12.1 (#6607)

loadams committed 2 years ago

Verified 20695b39

Merge branch 'master' into olruwase/set_zero_opt_grad

tjruwase committed 2 years ago

Verified 021dc0ab

Add SSF Best practices badge (#6604)

loadams committed 2 years ago

Verified 940887de

Cleanup CODEOWNERS file to be valid (#6603)

loadams committed 2 years ago

Verified 239b83a7

Merge branch 'master' into olruwase/set_zero_opt_grad

tjruwase committed 2 years ago

Verified 55b558ec

Update docs; Improve DS logging consistency

tjruwase committed 2 years ago

1fde1f3a

[ROCm] Fix subprocess error (#6587)

jagadish-amd committed 2 years ago

Verified b93c7a20

tjruwase committed 2 years ago

e88cad9d

tjruwase committed 2 years ago

c5892847

Merge branch 'master' into olruwase/set_zero_opt_grad

tjruwase committed 2 years ago

Verified 6110f70f

Add API for updating ZeRO gradients

tjruwase committed 2 years ago

18ee6cf2

Fix torch include in `op_builder/mlu/fused_adam.py` and update no-torch workflow triggers (#6584)

loadams committed 2 years ago

Verified 8cded575

Fixes on the accelerate side mean we do not need to skip this test (#6583)

loadams committed 2 years ago

Verified 828ddfbb

[COMPILE] workflow for deepspeed + torch.compile (#6570)

YizhouZ committed 2 years ago

Verified d4e18950

add bfloat16 to inference support dtypes (#6528)

nelyahu committed 2 years ago

Verified 1caf6e81

Add APIs to offload states of model, optimizer, and engine (#6011)

tohtana committed 2 years ago

Verified 047bcf6a

[XPU] Support DeepNVMe new code structure (#6532)

Liangliang-Ma committed 2 years ago

Verified d45cfd34

fix errors when setting zero3 leaf modules with torch.compile (#6564)

NirSonnenschein committed 2 years ago

Verified ba58682a

Fix gradient accumulation for Z2+offload (#6550)

tohtana committed 2 years ago

Verified c85c8703

[Accelerator] Cambricon MLU support (#6472)

Andy666G committed 2 years ago

Verified 0fbe96a5

DeepNVMe perf tuning (#6560)

tjruwase committed 2 years ago

Verified a5400974

Use msgpack for p2p comm (#6547)

tohtana committed 2 years ago

Verified 7622cd9e

Skip failing newly added tests in accelerate (#6574)

loadams committed 2 years ago

Verified 61de0171

Added Intel Gaudi to Accelerator Setup Guide (#6543)

ShifaAB committed 2 years ago

Verified 2a56f533

Add conditional on torch version for scaled_dot_product_attention (#6517)

loadams committed 2 years ago

Verified 170b46e8

Avoid security issues of subprocess shell (#6498)

tjruwase committed 2 years ago

Verified 659f6be1

wrap include cuda_bf16.h with ifdef BF16_AVAILABLE (#6520)

oelayan7 committed 2 years ago

Verified c2748393

Older