microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into jomayeri/aio-mem-fix

tohtana committed 1 year ago

Verified 429a7f22

Merge branch 'jomayeri/aio-mem-fix' of github.com:microsoft/DeepSpeed into jomayeri/aio-mem-fix

jomayeri committed 1 year ago

f3d7d04b

jomayeri committed 1 year ago

141de262

Use file store for tests (#6632)

tohtana committed 1 year ago

Verified c9fc34a4

Merge branch 'master' into jomayeri/aio-mem-fix

tohtana committed 1 year ago

Verified d7798d7c

Merge branch 'master' into jomayeri/aio-mem-fix

jomayeri committed 1 year ago

Verified 43b48f43

Update torch version in workflows (#6631)

tohtana committed 1 year ago

Verified a36db9cc

buffer to correct device

jomayeri committed 1 year ago

aa86469b

removing whitespace

jomayeri committed 1 year ago

802d9ca9

adding free to munlock

jomayeri committed 1 year ago

5c55f219

jomayeri committed 1 year ago

9bd11484

Add README Pipeline Status for Huawei Ascend NPU (#6588)

xuedinge233 committed 1 year ago

Verified c9899dc1

Lock cache file of HF model list (#6628)

tohtana committed 1 year ago

Verified 1a45bd8e

add option to disable logger while compiling to avoid graph breaks (#6496)

ShellyNR committed 1 year ago

Verified ce468c37

Support safetensors export (#6579)

xu-song committed 1 year ago

Verified bf60fc0c

Add first Step in LR Schedulers (#6597)

jomayeri committed 1 year ago

Verified 85b7469e

Accept btl_tcp_if_include option through launcher_args (#6613)

diskkid committed 1 year ago

Verified 13c16c95

Add API for updating ZeRO gradients (#6590)

tjruwase committed 1 year ago

Verified 65ab6448

[compile] Show breakdown of graph break (#6601)

delock committed 1 year ago

Verified cf41e8c4

Ignore reuse_dist_env (#6623)

tohtana committed 1 year ago

Verified 7a5bc4fd

apply fp16 autocast only to floating point values

Masahiro Tanaka committed 1 year ago

5c4b97f1

Add API to get devices of offload states (#6586)

tohtana committed 1 year ago

Verified adec9912

reduce setting global variables to reduce torch compile graph breaks (#6541)

NirSonnenschein committed 1 year ago

Verified d7ca3d83

AIO CPU Locked Tensor (#6592)

jomayeri committed 1 year ago

Verified a1f98bdc

Clean up prefetched parameters (#6557)

tohtana committed 1 year ago

Verified 7d751ee8

Update version.txt after 0.15.2 release (#6615)

loadams committed 1 year ago

Verified 55f7f378

Enabled Qwen2-MoE Tensor Parallelism (TP) inference (#6551)

gyou2021 committed 1 year ago

Verified 474a3288

Unpin accelerate tests, update lightning with node16 removal. (#6611)

loadams committed 1 year ago

Verified 1062a0c6

Rearrange inference OPS and stop using builder.load (#5490)

oelayan7 committed 1 year ago

Verified 645639bc

Handle when `backend` is also in compile_kwargs (#6502)

oraluben committed 1 year ago

Verified ca8b1fe9

Older