deepspeedai/DeepSpeed

Pull Requests Commits

Small tweak on cuda version mismatch documentation (#3706)

jli committed 2 years ago

Verified d414678d

Fix unit test typo in tests/unit/ops/transformer/inference (#3697)

mrwyattii committed 2 years ago

Verified fb2b4ab1

change partititon_name to partition_name (#3700)

digger-yu committed 2 years ago

Verified c5edc91e

Fix gpt-j inference issue (#3639)

RezaYazdaniAminabadi committed 2 years ago

Verified 34a9fbf1

Revert "fix typo name (#3689)" (#3702)

loadams committed 2 years ago

Verified 7e59ef12

enable base impls.

awan-10 committed 2 years ago

d35524f2

cleanup code and put base-impls for opt only.

awan-10 committed 2 years ago

ca2fed2d

fix typo name (#3689)

tensor-tang committed 2 years ago

Verified f2f5f21b

Fix incorrectly formatted f string (#3698)

loadams committed 2 years ago

Verified d8aaa581

Correct world_size/backend for mpi (#3694)

abhilash1910 committed 2 years ago

Verified c17313fb

Fix local rank mismatch for heterogeneous nodes (#3409)

byungsoo-oh committed 2 years ago

Verified b7f463dd

non-JIT build fix on ROCm (#3638)

rraminen committed 2 years ago

Verified 4cd0a003

Update README to add ICS'23 paper (#3687)

siddharth9820 committed 2 years ago

Verified 2d737edd

Use logger in accelerator (#3682)

tjruwase committed 2 years ago

Verified e5fe5f65

100 percent match between DS (base_mlp + base_attn) and HF.

awan-10 committed 2 years ago

f169851c

Revert "Comment out bias add in attn"

awan-10 committed 2 years ago

1794a144

fix some typo (#3675)

digger-yu committed 2 years ago

Verified 3fb3cfdc

Comment out bias add in attn

molly-smith committed 2 years ago

25870306

remove deepcopy to avoid incompatible torch.jit.script modules.

awan-10 committed 2 years ago

d2b70933

[MiCS] [Fix] saving and loading model checkpoint logic for MiCS sharding (#3440)

zarzen committed 2 years ago

Verified c88af214

jeffra committed 2 years ago

f483c034

Refactor check_enabled root validator in DeepSpeedMonitorConfig (#3616)

bgr8 committed 2 years ago

Verified 4559aa9b

fix typo deepspeed/runtime (#3663)

digger-yu committed 2 years ago

Verified 5d14afd2

flops_profiler: add option recompute_fwd_factor for the case of activation recompute (#3362)

guoyejun committed 2 years ago

Verified 460bec46

fix typo with deepspeed/ (#3547)

digger-yu committed 2 years ago

Verified cd4e473e

Set attention past_layer to presents every pass

molly-smith committed 2 years ago

1fa46ee1

allow dict datatype for checkpoints (#3007)

mrwyattii committed 2 years ago

Verified da8f4e01

Fix RuntimeError when using ZeRO Stage3 with mpu: #3564 (#3565)

eggiter committed 2 years ago

Verified f5dde36c

typo and uncomment mlp bias add

molly-smith committed 2 years ago

dedb3d85

deepspeed/comm/comm.py: fix typo of warning message (#3636)

guoyejun committed 2 years ago

Verified 3b299997

Newer Older