microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into staging-ds-seq-v1

samadejacobs committed 2 years ago

Verified 0e06bacc

undo mistakenly removed license.

awan-10 committed 2 years ago

7c073970

remove debug print.

awan-10 committed 2 years ago

42c2cf0c

awan-10 committed 2 years ago

13793ce6

DeepSpeed Ulysses tutorial (#4200)

minjiaz committed 2 years ago

Verified b5453990

Merge branch 'master' into staging-ds-seq-v1

samadejacobs committed 2 years ago

Verified f7f34157

Fix ZeRO parameter initialization for tensors with `requires_grad=True` (#4138)

XuehaiPan committed 2 years ago

Verified 426810a2

Add unit test to check HF low_cpu_mem_usage_flag (#4184)

loadams committed 2 years ago

Verified 9723a879

Fix path (#4193)

kytimmylai committed 2 years ago

Verified 6c684e12

Fix nv-nightly workflow (#4163)

mrwyattii committed 2 years ago

Verified d9a889d5

enable autoTP for mpt in huggingface model hub without trust_remote_code (#4062)

sywangyi committed 2 years ago

Verified 5e16eb2c

Treat empty environment variables as unset in (#4185)

loadams committed 2 years ago

Verified 8fb111c0

do allgather only in shared optimizer states groups (#4167)

inkcherry committed 2 years ago

Verified 7f3e82fe

MP ZeRO++ (#3954)

HeyangQin committed 2 years ago

Verified 7711bdbb

jeffra committed 2 years ago

f036f00c

pin transformers to last known good commit (#4174)

mrwyattii committed 2 years ago

Verified 46d859a7

Add DSE branch input to nv-ds-chat (#4173)

lekurile committed 2 years ago

Verified a3540f17

[CPU][Bugfix] Make uid and addr_port part of SHM name in CCL backend (#4115)

delock committed 2 years ago

Verified 19e9a7c0

Add DS-Chat CI workflow (#4127)

lekurile committed 2 years ago

Verified 64c670ef

fix badges (#4162)

mrwyattii committed 2 years ago

Verified bd65eeaf

Handling for SIGTERM as well (#4160)

loadams committed 2 years ago

Verified 1a295739

Fixes #4151 (#4152)

saforem2 committed 2 years ago

Verified 740b7805

Return nn.parameter type for weights and biases (#4146)

molly-smith committed 2 years ago

Verified 341cefd2

Remove incorrect async-io library checking code. (#4150)

loadams committed 2 years ago

Verified a4523018

Respect memory pinning config (#4131)

tjruwase committed 2 years ago

Verified 9d79cfd1

Generalize frozen weights unit test (#4140)

tjruwase committed 2 years ago

Verified 7a282db8

Handle PermissionError in os.chmod Call - Update engine.py (#4139)

M-Chris committed 2 years ago

Verified 629b2039

DeepSpeed Sequence (#535)

samadejacobs committed 2 years ago

Verified 368976fc

Update torch1.9 tests to 1.10 to match latest accelerate. (#4126)

loadams committed 2 years ago

Verified ff7d5275

Merge branch 'master' of github.com:microsoft/DeepSpeed

jeffra committed 2 years ago

38bb5523

Older