microsoft/DeepSpeed

Pull Requests Commits

Merge remote-tracking branch 'origin/staging-ds-seq-v1' into minjiaz/ds-seq-tutorial

awan-10 committed 1 year ago

9171427c

Merge branch 'master' into staging-ds-seq-v1

samadejacobs committed 1 year ago

Verified f7f34157

Fix ZeRO parameter initialization for tensors with `requires_grad=True` (#4138)

XuehaiPan committed 1 year ago

Verified 426810a2

Update ds-sequence.md

samadejacobs committed 1 year ago

Verified df5c0efd

Add unit test to check HF low_cpu_mem_usage_flag (#4184)

loadams committed 1 year ago

Verified 9723a879

Fix path (#4193)

kytimmylai committed 1 year ago

Verified 6c684e12

Fix nv-nightly workflow (#4163)

mrwyattii committed 1 year ago

Verified d9a889d5

enable autoTP for mpt in huggingface model hub without trust_remote_code (#4062)

sywangyi committed 1 year ago

Verified 5e16eb2c

Treat empty environment variables as unset in (#4185)

loadams committed 1 year ago

Verified 8fb111c0

Update ds-sequence.md

samadejacobs committed 1 year ago

Verified 59c6bfc7

Fix one subtitle

minjiaz committed 1 year ago

0ec7e42e

Adding a tutorial for DS-Seq

minjiaz committed 1 year ago

079196ac

do allgather only in shared optimizer states groups (#4167)

inkcherry committed 1 year ago

Verified 7f3e82fe

MP ZeRO++ (#3954)

HeyangQin committed 1 year ago

Verified 7711bdbb

jeffra committed 1 year ago

f036f00c

pin transformers to last known good commit (#4174)

mrwyattii committed 1 year ago

Verified 46d859a7

Add DSE branch input to nv-ds-chat (#4173)

lekurile committed 1 year ago

Verified a3540f17

[CPU][Bugfix] Make uid and addr_port part of SHM name in CCL backend (#4115)

delock committed 1 year ago

Verified 19e9a7c0

Add DS-Chat CI workflow (#4127)

lekurile committed 1 year ago

Verified 64c670ef

fix badges (#4162)

mrwyattii committed 1 year ago

Verified bd65eeaf

Handling for SIGTERM as well (#4160)

loadams committed 1 year ago

Verified 1a295739

Fixes #4151 (#4152)

saforem2 committed 1 year ago

Verified 740b7805

Return nn.parameter type for weights and biases (#4146)

molly-smith committed 1 year ago

Verified 341cefd2

Remove incorrect async-io library checking code. (#4150)

loadams committed 1 year ago

Verified a4523018

Respect memory pinning config (#4131)

tjruwase committed 1 year ago

Verified 9d79cfd1

Generalize frozen weights unit test (#4140)

tjruwase committed 1 year ago

Verified 7a282db8

Handle PermissionError in os.chmod Call - Update engine.py (#4139)

M-Chris committed 1 year ago

Verified 629b2039

DeepSpeed Sequence (#535)

samadejacobs committed 1 year ago

Verified 368976fc

Update torch1.9 tests to 1.10 to match latest accelerate. (#4126)

loadams committed 1 year ago

Verified ff7d5275

Merge branch 'master' of github.com:microsoft/DeepSpeed

jeffra committed 1 year ago

38bb5523

Older