microsoft/DeepSpeed

Pull Requests Commits

fixing default communication_data_type for bfloat16_enabled and docs (#3370)

Alexander Jipa committed 2 years ago

Verified d56268f3

Fix redundant shared_params in zero_to_fp32.py (#3149)

ShijieZZZZ committed 2 years ago

Verified 39825a90

add deepspeed chat blog links, add tags (#3369)

conglongli committed 2 years ago

Verified 085981bf

Update DS-Chat issue template (#3368)

mrwyattii committed 2 years ago

Verified 3031eec4

fix mpich launcher issue in multi-node (#3078)

sywangyi committed 2 years ago

Verified a748bfc6

hybrid_engine: check tuple size when fusing lora params (#3311)

adammoody committed 2 years ago

Verified c9196b61

README.md: Update MosaicML docs link (#3344)

kobindra committed 2 years ago

Verified 39b429d5

add bf16 cuda kernel support (#3092)

dc3671 committed 2 years ago

Verified 297cd9ed

print default values (#3347)

mrwyattii committed 2 years ago

Verified 2f8d384e

Diffusers 0.15.0 bug fix (#3345)

molly-smith committed 2 years ago

Verified 496a9a3a

Hipify cooperative_groups headers (#3323)

rraminen committed 2 years ago

Verified 6e1cbebe

Fix formatting (#3343)

mrwyattii committed 2 years ago

Verified 4a3ca4e2

jeffra committed 2 years ago

78afab04

Explicitly check for OPT activation function (#3278)

cmikeh2 committed 2 years ago

Verified 793c23e5

Fix missing scale attributes for GPTJ (#3256)

cmikeh2 committed 2 years ago

Verified 145c3a75

Fix for dist not being initialized when constructing main config (#3324)

mrwyattii committed 2 years ago

Verified ad168a69

zero3 checkpoint frozen params (#3205)

tjruwase committed 2 years ago

Verified dd8df20f

Update Dockerfile (#3298)

bobowwb committed 2 years ago

Verified ab1d2f82

Update README.md (#3315)

digger-yu committed 2 years ago

Verified dd902a3c

Add pre-compiling ops test (#3277)

loadams committed 2 years ago

Verified 4de4d2ac

Update MI200 workflow to install apex with changes from pip (#3294)

loadams committed 2 years ago

Verified 61a8b3a0

remove `torch.cuda.is_available()` check when compiling ops (#3085)

jinzhen-lin committed 2 years ago

Verified 036c5d6d

Update README.md (#3282)

digger-yu committed 2 years ago

Verified c381dd16

Fix pydantic and autodoc_pydantic (#3290)

loadams committed 2 years ago

Verified 08905623

[ROCm] temporary workaround till __double2half support enabled in HIP (#3236)

bmedishe committed 2 years ago

Verified f7bfe5e7

Fix cupy install version detection (#3276)

mrwyattii committed 2 years ago

Verified bcccee4d

Update install.sh (#3270)

digger-yu committed 2 years ago

Verified 077e42e6

improving int4 asymmetric quantization accuracy (#3190)

HeyangQin committed 2 years ago

Verified 48297c48

fix typo in autotuner.py (#3269)

eltociear committed 2 years ago

Verified 050aee28

update link to PL docs (#3237)

Borda committed 2 years ago

Verified 6dbff771

Older