microsoft/DeepSpeed

Pull Requests Commits

Test with Triton 2+

loadams committed 2 years ago

55cafd36

Merge branch 'master' into loadams/update-sd-triton

loadams committed 2 years ago

4352ce7f

MP ZeRO++ (#3954)

HeyangQin committed 2 years ago

Verified 7711bdbb

jeffra committed 2 years ago

f036f00c

pin transformers to last known good commit (#4174)

mrwyattii committed 2 years ago

Verified 46d859a7

Add DSE branch input to nv-ds-chat (#4173)

lekurile committed 2 years ago

Verified a3540f17

[CPU][Bugfix] Make uid and addr_port part of SHM name in CCL backend (#4115)

delock committed 2 years ago

Verified 19e9a7c0

Add DS-Chat CI workflow (#4127)

lekurile committed 2 years ago

Verified 64c670ef

fix badges (#4162)

mrwyattii committed 2 years ago

Verified bd65eeaf

Handling for SIGTERM as well (#4160)

loadams committed 2 years ago

Verified 1a295739

Fixes #4151 (#4152)

saforem2 committed 2 years ago

Verified 740b7805

Return nn.parameter type for weights and biases (#4146)

molly-smith committed 2 years ago

Verified 341cefd2

Remove incorrect async-io library checking code. (#4150)

loadams committed 2 years ago

Verified a4523018

Respect memory pinning config (#4131)

tjruwase committed 2 years ago

Verified 9d79cfd1

Generalize frozen weights unit test (#4140)

tjruwase committed 2 years ago

Verified 7a282db8

Handle PermissionError in os.chmod Call - Update engine.py (#4139)

M-Chris committed 2 years ago

Verified 629b2039

Update torch1.9 tests to 1.10 to match latest accelerate. (#4126)

loadams committed 2 years ago

Verified ff7d5275

Merge branch 'master' into loadams/update-sd-triton

loadams committed 2 years ago

Verified c0ec7c39

Update nightly workflows to open an issue if CI fails (#3952)

loadams committed 2 years ago

Verified 0c75f4a3

Add ops (#4119)

loadams committed 2 years ago

Verified d300517f

Fix Issue 4083 (#4084)

jomayeri committed 2 years ago

Verified 8a8683d3

enable pipeline checkpoint loading mode (#3629)

leiwen83 committed 2 years ago

Verified 1e0c39c6

add deepspeed chat arxiv report (#4110)

conglongli committed 2 years ago

Verified 78d985ab

Pass correct node size for ZeRO++ (#4085)

cmikeh2 committed 2 years ago

Verified f0463b4d

Disable z3 tracing profiler (#4106)

tjruwase committed 2 years ago

Verified 977254c1

use correct ckpt path when base_dir not available (#4101)

polisettyvarma committed 2 years ago

Verified abe293b4

set temperature to avoid config validation error (#4107)

mrwyattii committed 2 years ago

Verified 975bcbc0

add type checker ignore to resolve that pylance can't resolved noqa annotation (#4102)

EeyoreLee committed 2 years ago

Verified 57a27b08

zero_to_fp32 script adds support for tag argument (#4089)

EeyoreLee committed 2 years ago

Verified 241ae39a

update ut/doc for glm/codegen (#4057)

inkcherry committed 2 years ago

Verified 85dc854b

Older