deepspeedai/DeepSpeed

Pull Requests Commits

fix _all_gather in zero3

HeyangQin committed 2 years ago

9e277ba8

Merge branch 'master' into HeyangQin/mixed_precision_lora

awan-10 committed 2 years ago

Verified 3d527b24

jeffra committed 2 years ago

f036f00c

Merge branch 'master' into HeyangQin/mixed_precision_lora

HeyangQin committed 2 years ago

Verified a6bd4544

pin transformers to last known good commit (#4174)

mrwyattii committed 2 years ago

Verified 46d859a7

Merge branch 'master' into HeyangQin/mixed_precision_lora

awan-10 committed 2 years ago

Verified f8020116

Add DSE branch input to nv-ds-chat (#4173)

lekurile committed 2 years ago

Verified a3540f17

Merge branch 'master' into HeyangQin/mixed_precision_lora

HeyangQin committed 2 years ago

Verified 9f68cdad

seperate code and tutorial

HeyangQin committed 2 years ago

74c27605

[CPU][Bugfix] Make uid and addr_port part of SHM name in CCL backend (#4115)

delock committed 2 years ago

Verified 19e9a7c0

HeyangQin committed 2 years ago

b5a41fab

add kwargs to mics

HeyangQin committed 2 years ago

d5013092

Add DS-Chat CI workflow (#4127)

lekurile committed 2 years ago

Verified 64c670ef

Merge remote-tracking branch 'origin/master' into HeyangQin/mixed_precision_lora

HeyangQin committed 2 years ago

f7cb5493

fix badges (#4162)

mrwyattii committed 2 years ago

Verified bd65eeaf

Handling for SIGTERM as well (#4160)

loadams committed 2 years ago

Verified 1a295739

Fixes #4151 (#4152)

saforem2 committed 2 years ago

Verified 740b7805

Return nn.parameter type for weights and biases (#4146)

molly-smith committed 2 years ago

Verified 341cefd2

Remove incorrect async-io library checking code. (#4150)

loadams committed 2 years ago

Verified a4523018

Respect memory pinning config (#4131)

tjruwase committed 2 years ago

Verified 9d79cfd1

Generalize frozen weights unit test (#4140)

tjruwase committed 2 years ago

Verified 7a282db8

Handle PermissionError in os.chmod Call - Update engine.py (#4139)

M-Chris committed 2 years ago

Verified 629b2039

Update torch1.9 tests to 1.10 to match latest accelerate. (#4126)

loadams committed 2 years ago

Verified ff7d5275

Update nightly workflows to open an issue if CI fails (#3952)

loadams committed 2 years ago

Verified 0c75f4a3

Add ops (#4119)

loadams committed 2 years ago

Verified d300517f

Fix Issue 4083 (#4084)

jomayeri committed 2 years ago

Verified 8a8683d3

enable pipeline checkpoint loading mode (#3629)

leiwen83 committed 2 years ago

Verified 1e0c39c6

add deepspeed chat arxiv report (#4110)

conglongli committed 2 years ago

Verified 78d985ab

Pass correct node size for ZeRO++ (#4085)

cmikeh2 committed 2 years ago

Verified f0463b4d

Disable z3 tracing profiler (#4106)

tjruwase committed 2 years ago

Verified 977254c1

Older