microsoft/DeepSpeed

Pull Requests Commits

Fixing the reshape bug in sequence parallel alltoall, which corrupted all QKV data (#5664)

YJHMITWEB committed 2 years ago

Verified 3bdd187e

Merge branch 'master' into jomayeri/zero3-hooks

tjruwase committed 2 years ago

Verified 6b75fcac

Fix hpZ with zero element (#5652)

samadejacobs committed 2 years ago

Verified b33873d2

Remove compile wrapper to simplify access to model attributes (#5581)

tohtana committed 2 years ago

Verified 2a0c0e3c

fix IDEX dependence in xpu accelerator (#5666)

Liangliang-Ma committed 2 years ago

Verified 8831b57b

[XPU] adapt lazy_call func to different versions (#5670)

YizhouZ committed 2 years ago

Verified 73316307

_exec_forward_pass: place zeros(1) on the same device as the param (#5576)

nelyahu committed 2 years ago

Verified 05cb79db

jomayeri committed 2 years ago

318929c8

Merge branch 'master' into jomayeri/zero3-hooks

jomayeri committed 2 years ago

Verified 93bd49e5

[CPU] SHM based allreduce improvement for small message size (#5571)

delock committed 2 years ago

Verified eda5075b

Update version.txt after 0.14.3 release (#5651)

mrwyattii committed 2 years ago

Verified dfcade24

Monitor was always enabled causing performance degradation (#5633)

deepcharm committed 2 years ago

Verified 54f98fd9

pipe/_exec_backward_pass: fix immediate grad update (#5605)

nelyahu committed 2 years ago

Verified 91a9986d

assumption of torch.initial_seed function accepting seed arg in DeepSpeedAccelerator abstract class is incorrect (#5569)

Polisetty V R K Jyothendra Varma committed 2 years ago

Verified ac935c7f

fixes in _partition_param_sec function (#5613)

mmhab committed 2 years ago

Verified b6e24adb

Fix overlap communication of ZeRO stage 1 and 2 (#5606)

penn513 committed 2 years ago

Verified a41729f6

stage_1_and_2: optimize clip calculation to use clamp (#5632)

nelyahu committed 2 years ago

Verified 1ef9b029

WA for Torch-compile-Z3-act-apt accuracy issue from the Pytorch repo (#5590)

NirSonnenschein committed 2 years ago

Verified 6e2899fb

Pin transformers version for MII tests (#5629)

loadams committed 2 years ago

Verified 31a57fa3

Updated hpu-gaudi2 tests content. (#5622)

vshekhawat-hlab committed 2 years ago

Verified 69adeab6

Add Compressedbackend for Onebit optimizers (#5473)

Liangliang-Ma committed 2 years ago

Verified 11a62a06

fix sequence parallel(Ulysses) grad scale for zero0 (#5555)

inkcherry committed 2 years ago

Verified 6b6d6418

Fix cuda hardcode for inference woq (#5565)

Liangliang-Ma committed 2 years ago

Verified af4356b3

estimate_zero2_model_states_mem_needs: fixing memory estiamtion (#5099)

nelyahu committed 2 years ago

Verified f4cb866c

Fixed the Windows build. (#5596)

costin-eseanu committed 2 years ago

Verified e7dd28a2

Add slide deck for meetup in Japan (#5598)

tohtana committed 2 years ago

Verified 77c94942

Update minor CUDA version compatibility (#5591)

adk9 committed 2 years ago

Verified 1baf6884

adding hooks context manager

root committed 2 years ago

d36ecdf0

DeepSpeedCheckpoint: support custom final ln idx (#5506)

nelyahu committed 2 years ago

Verified 2fc702ed

Update to fix sidebar over text (#5567)

loadams committed 2 years ago

Verified 4deb40de

Newer Older