deepspeedai/DeepSpeed

Pull Requests Commits

Merge branch 'master' into costineseanu/windows_inference_build

costin-eseanu committed 1 year ago

Verified 87b9ad85

Update version.txt after 0.14.4 release (#5694)

mrwyattii committed 1 year ago

Verified d89e8cdf

[XPU] support op builder from intel_extension_for_pytorch kernel path (#5425)

YizhouZ committed 1 year ago

Verified d254d75e

Update BUFSIZE to come from autotuner's constants.py, not numpy (#5686)

loadams committed 1 year ago

Verified 0c979d67

Merge branch 'master' into costineseanu/windows_inference_build

tjruwase committed 1 year ago

Verified ee36e535

Fix numpy upgrade to 2.0.0 BUFSIZE import error (#5680)

Yejing-Lai committed 1 year ago

Verified 4000cee8

Fix latest pytorch '_get_socket_with_port' import error (#5654)

Yejing-Lai committed 1 year ago

Verified a4cd5504

enable yuan autotp & add conv tp (#5428)

Yejing-Lai committed 1 year ago

Verified 8ea995ee

Fixing the reshape bug in sequence parallel alltoall, which corrupted all QKV data (#5664)

YJHMITWEB committed 1 year ago

Verified 3bdd187e

Fix hpZ with zero element (#5652)

samadejacobs committed 1 year ago

Verified b33873d2

Remove compile wrapper to simplify access to model attributes (#5581)

tohtana committed 1 year ago

Verified 2a0c0e3c

fix IDEX dependence in xpu accelerator (#5666)

Liangliang-Ma committed 1 year ago

Verified 8831b57b

[XPU] adapt lazy_call func to different versions (#5670)

YizhouZ committed 1 year ago

Verified 73316307

_exec_forward_pass: place zeros(1) on the same device as the param (#5576)

nelyahu committed 1 year ago

Verified 05cb79db

Merge branch 'master' into costineseanu/windows_inference_build

costin-eseanu committed 1 year ago

Verified 8f2f5b73

Fixed divide by zero caused by coarse time resolution on Windows. Replaced NCCL with GLOO on Windows.

Costin Eseanu committed 1 year ago

f95d5f32

Fix BF16 not being built on Win. Fixed consecutive builds on Windows failing.

Costin Eseanu committed 1 year ago

07aa5bfc

[CPU] SHM based allreduce improvement for small message size (#5571)

delock committed 1 year ago

Verified eda5075b

Merge branch 'master' into costineseanu/windows_inference_build

loadams committed 1 year ago

Verified 5878121c

Update version.txt after 0.14.3 release (#5651)

mrwyattii committed 1 year ago

Verified dfcade24

Merge branch 'master' into costineseanu/windows_inference_build

costin-eseanu committed 1 year ago

Verified 6f8180a7

Monitor was always enabled causing performance degradation (#5633)

deepcharm committed 1 year ago

Verified 54f98fd9

assumption of torch.initial_seed function accepting seed arg in DeepSpeedAccelerator abstract class is incorrect (#5569)

polisettyvarma committed 1 year ago

Verified ac935c7f

pipe/_exec_backward_pass: fix immediate grad update (#5605)

nelyahu committed 1 year ago

Verified 91a9986d

fixes in _partition_param_sec function (#5613)

mmhab committed 1 year ago

Verified b6e24adb

Fix overlap communication of ZeRO stage 1 and 2 (#5606)

penn513 committed 1 year ago

Verified a41729f6

stage_1_and_2: optimize clip calculation to use clamp (#5632)

nelyahu committed 1 year ago

Verified 1ef9b029

WA for Torch-compile-Z3-act-apt accuracy issue from the Pytorch repo (#5590)

NirSonnenschein committed 1 year ago

Verified 6e2899fb

Pin transformers version for MII tests (#5629)

loadams committed 1 year ago

Verified 31a57fa3

Updated hpu-gaudi2 tests content. (#5622)

vshekhawat-hlab committed 1 year ago

Verified 69adeab6

Older