microsoft/DeepSpeed

Pull Requests Commits

add two optimizer changes in cpp files

Bing Xie committed 2 years ago

f07c02a9

Merge branch 'master' into olruwase/cuda_optional_ops

tjruwase committed 2 years ago

Verified 4d470472

jeffra committed 2 years ago

7d0e4270

ZeRO3 handling frozen weights] (#2653)

tjruwase committed 2 years ago

Verified bf6b9802

Merge branch 'master' into olruwase/cuda_optional_ops

tjruwase committed 2 years ago

Verified 5e2d5567

remove print side effect from importing deepspeed (#2704)

jeffra committed 2 years ago

Verified 35575bce

Merge branch 'master' into olruwase/cuda_optional_ops

tjruwase committed 2 years ago

Verified 4aaf7887

non-MoE stage 1 requires CG disabled (#2703)

jeffra committed 2 years ago

Verified e4ba7222

Merge branch 'master' into olruwase/cuda_optional_ops

tjruwase committed 2 years ago

Verified dc7017f2

using correct loss scale in zero step (#2695)

jomayeri committed 2 years ago

Verified fe728e3e

exclude benchmarks during install (#2698)

jeffra committed 2 years ago

Verified cd271a4a

fix for latest diffusers (#2699)

mrwyattii committed 2 years ago

Verified c9c6ab9e

Resolve conflict

tjruwase committed 2 years ago

3aead39b

[GatheredParameters] add support for any iterator (#2664)

stas00 committed 2 years ago

Verified 217cc07b

Merge branch 'master' into olruwase/cuda_optional_ops

tjruwase committed 2 years ago

Verified fbde29cc

tjruwase committed 2 years ago

93bc3384

Extend quantization utils features (#2683)

lokoppakmsft committed 2 years ago

Verified aef8a856

Pass training flag to forward call from Eval (#2604)

lokoppakmsft committed 2 years ago

Verified e7c14026

Merge branch 'master' into olruwase/cuda_optional_ops

tjruwase committed 2 years ago

Verified 9b344a2f

fix import path to op_builder (#2687)

tohtana committed 2 years ago

Verified cf9e433f

Merge branch 'master' into olruwase/cuda_optional_ops

tjruwase committed 2 years ago

Verified a8abd7c6

Add mlflow logging for aml (#2495)

cassieesvelt committed 2 years ago

Verified a3d7f106

Merge branch 'master' into olruwase/cuda_optional_ops

tjruwase committed 2 years ago

Verified b94c878d

remove duplicated code in ZeRO (#2655)

wkcn committed 2 years ago

Verified 89da037e

Merge branch 'master' into olruwase/cuda_optional_ops

tjruwase committed 2 years ago

Verified ca9ffd30

real_accelerator validation check for both accelerator and deepspeed.accelerator path (#2685)

delock committed 2 years ago

Verified 62c071e0

Merge branch 'master' into olruwase/cuda_optional_ops

tjruwase committed 2 years ago

Verified f5a44d36

[inference] ds-mlp refactor w.r.t. ops (#2668)

jeffra committed 2 years ago

Verified c702b64c

fix Tensor contiguous bug in model_compression (#2671)

xiaoxiawu-microsoft committed 2 years ago

Verified be6d19f0

[fp16] lower initial_scale_power (#2663)

stas00 committed 2 years ago

Verified f30a0308

Older