microsoft/DeepSpeed

Pull Requests Commits

fix some typo (#3675)

digger-yu committed 2 years ago

60ae7915

remove deepcopy to avoid incompatible torch.jit.script modules.

awan-10 committed 2 years ago

d2b1b790

[MiCS] [Fix] saving and loading model checkpoint logic for MiCS sharding (#3440)

zarzen committed 2 years ago

74274aea

jeffra committed 2 years ago

5dc72c76

Refactor check_enabled root validator in DeepSpeedMonitorConfig (#3616)

bgr8 committed 2 years ago

45d3b038

fix typo deepspeed/runtime (#3663)

digger-yu committed 2 years ago

bb967f1e

flops_profiler: add option recompute_fwd_factor for the case of activation recompute (#3362)

guoyejun committed 2 years ago

b35931c8

fix typo with deepspeed/ (#3547)

digger-yu committed 2 years ago

ac0a37de

allow dict datatype for checkpoints (#3007)

mrwyattii committed 2 years ago

b87d6c25

Fix RuntimeError when using ZeRO Stage3 with mpu: #3564 (#3565)

eggiter committed 2 years ago

e92f7c91

deepspeed/comm/comm.py: fix typo of warning message (#3636)

guoyejun committed 2 years ago

f67ed8e2

Typo Correction (#3621)

Micah Zoltu committed 2 years ago

d02d5252

Update megatron.md (#3641)

wjessup committed 2 years ago

74f925ad

Skip tests on docs-only changes (#3651)

mrwyattii committed 2 years ago

1ce9e652

Add Ascend NPU accelerator support (#3595)

CurryRice233 committed 2 years ago

80e656c6

stage3.py: do not scale if gradient_predivide_factor is 1.0 (#3630)

guoyejun committed 2 years ago

149f60b7

AISC launcher fixes (#3637)

jeffra committed 2 years ago

003b62cc

Align InferenceEngine to store ms in _model_times (#3501)

HolyFalafel committed 2 years ago

a55c4da8

Expose Consecutive Hysteresis to Users (#3553)

Quentin-Anthony committed 2 years ago

7f9bff7e

DS init should not broadcast or move zero.Init models (#3611)

tjruwase committed 2 years ago

cd5148f3

bug fix (#3609)

conglongli committed 2 years ago

f424b44a

Fix op_builder against PyTorch nightly (#3596)

malfet committed 2 years ago

9123ee6e

Fix Hybrid Engine for BLOOM (#3580)

lekurile committed 2 years ago

1808f9d8

Fixing bf16 test (#3551)

jomayeri committed 2 years ago

4e67e8b0

fix_typo (#3559)

inkcherry committed 2 years ago

1b225931

he with opt-baseline impl. now works.

awan-10 committed 2 years ago

fa69a21d

fix for transposed mode.

awan-10 committed 2 years ago

554670c7

enable base impls.

awan-10 committed 2 years ago

b9253524

cleanup code and put base-impls for opt only.

awan-10 committed 2 years ago

b0caf688

100 percent match between DS (base_mlp + base_attn) and HF.

awan-10 committed 2 years ago

2a9835d4

Newer Older