microsoft/DeepSpeed

Pull Requests Commits

remaking changes from #1775

mrwyattii committed 1 year ago

67100710

Fix ZeRO parameter initialization for tensors with `requires_grad=True` (#4138)

XuehaiPan committed 1 year ago

Verified 426810a2

Add unit test to check HF low_cpu_mem_usage_flag (#4184)

loadams committed 1 year ago

Verified 9723a879

Fix path (#4193)

kytimmylai committed 1 year ago

Verified 6c684e12

Fix nv-nightly workflow (#4163)

mrwyattii committed 1 year ago

Verified d9a889d5

enable autoTP for mpt in huggingface model hub without trust_remote_code (#4062)

sywangyi committed 1 year ago

Verified 5e16eb2c

Treat empty environment variables as unset in (#4185)

loadams committed 1 year ago

Verified 8fb111c0

do allgather only in shared optimizer states groups (#4167)

inkcherry committed 1 year ago

Verified 7f3e82fe

MP ZeRO++ (#3954)

HeyangQin committed 1 year ago

Verified 7711bdbb

jeffra committed 1 year ago

f036f00c

pin transformers to last known good commit (#4174)

mrwyattii committed 1 year ago

Verified 46d859a7

Add DSE branch input to nv-ds-chat (#4173)

lekurile committed 1 year ago

Verified a3540f17

[CPU][Bugfix] Make uid and addr_port part of SHM name in CCL backend (#4115)

delock committed 1 year ago

Verified 19e9a7c0

Add DS-Chat CI workflow (#4127)

lekurile committed 1 year ago

Verified 64c670ef

fix badges (#4162)

mrwyattii committed 1 year ago

Verified bd65eeaf

Handling for SIGTERM as well (#4160)

loadams committed 1 year ago

Verified 1a295739

Fixes #4151 (#4152)

saforem2 committed 1 year ago

Verified 740b7805

Return nn.parameter type for weights and biases (#4146)

molly-smith committed 1 year ago

Verified 341cefd2

Remove incorrect async-io library checking code. (#4150)

loadams committed 1 year ago

Verified a4523018

Respect memory pinning config (#4131)

tjruwase committed 1 year ago

Verified 9d79cfd1

Generalize frozen weights unit test (#4140)

tjruwase committed 1 year ago

Verified 7a282db8

Handle PermissionError in os.chmod Call - Update engine.py (#4139)

M-Chris committed 1 year ago

Verified 629b2039

Update torch1.9 tests to 1.10 to match latest accelerate. (#4126)

loadams committed 1 year ago

Verified ff7d5275

Update nightly workflows to open an issue if CI fails (#3952)

loadams committed 1 year ago

Verified 0c75f4a3

Add ops (#4119)

loadams committed 1 year ago

Verified d300517f

Fix Issue 4083 (#4084)

jomayeri committed 1 year ago

Verified 8a8683d3

enable pipeline checkpoint loading mode (#3629)

leiwen83 committed 1 year ago

Verified 1e0c39c6

add deepspeed chat arxiv report (#4110)

conglongli committed 1 year ago

Verified 78d985ab

Pass correct node size for ZeRO++ (#4085)

cmikeh2 committed 1 year ago

Verified f0463b4d

Disable z3 tracing profiler (#4106)

tjruwase committed 1 year ago

Verified 977254c1

Older