microsoft/DeepSpeed

Pull Requests Commits

Fix torch requirements on nccl

loadams committed 2 years ago

a10edc01

fix CI badges (#3138)

mrwyattii committed 2 years ago

Verified f2c9a827

Fix launch issue (#3137)

tjruwase committed 2 years ago

Verified fcb868e2

Update SD triton version in requirements-sd.txt (#3135)

lekurile committed 2 years ago

Verified fcc0d9c0

[docs] fix blog links

jeffra committed 2 years ago

62db3c0d

VL MoE Blog (#3120)

yaozhewei committed 2 years ago

Verified 1242d8b4

added full apache license (#3119)

mrwyattii committed 2 years ago

Verified 6c4782b0

Update DeepSpeed copyright license to Apache 2.0 (#3111)

mrwyattii committed 2 years ago

Verified b361c727

Make fp32 default communication data type (#2970)

tjruwase committed 2 years ago

Verified 261d6370

♻️ replace deprecated functions for communication (#2995)

mayank31398 committed 2 years ago

Verified a6317eb5

Disable Stage 1&2 CPUAdam pathways (#3097)

mrwyattii committed 2 years ago

Verified 4b6d7c15

Fix comms benchmark import issues and support MPI/slurm launching (#2932)

Quentin-Anthony committed 2 years ago

Verified 9726bd46

update formatter version and style settings (#3098)

jeffra committed 2 years ago

Verified 91d63e02

Move cuda check into utils (#3074)

loadams committed 2 years ago

Verified b3ec1c97

pre-commit check for torch.cuda in code (#2981)

delock committed 2 years ago

Verified 090d49e7

Empty ZeRO3 partition cache (#3060)

tjruwase committed 2 years ago

Verified e80ae088

Goodbye Torch 1.8 (#3082)

mrwyattii committed 2 years ago

Verified 5cdf3593

allow list (#3042)

satpalsr committed 2 years ago

Verified 5c2a81c2

Fix nebula in save_16bit_model issue (#3023)

FreyaRao committed 2 years ago

Verified a78d6b89

Softmax Scheduling Cleanup (#3046)

cmikeh2 committed 2 years ago

Verified 1286e374

Remove bf16 from inference config dtye enum (#3010)

molly-smith committed 2 years ago

Verified 27e1b02d

fix return prev key and value , added strides to from_blob (#2828)

mzusman committed 2 years ago

Verified 871c8a3f

[CI] follow-up fixes (#3072)

jeffra committed 2 years ago

Verified 36677588

Assert mp_size is factor of model dimensions (#2891)

molly-smith committed 2 years ago

Verified 9ea0fdc2

Several fixes to unblock CI (#3047)

loadams committed 2 years ago

Verified 4e068623

[docs] add MCR-DL paper to readme/docs (#3066)

Quentin-Anthony committed 2 years ago

Verified b38b3036

Fix Broken Links (#3048)

satpalsr committed 2 years ago

Verified f1e4fb0b

update email info

jeffra committed 2 years ago

Verified bbfd0a6a

Improve loss overflow logs (#3008)

Quentin-Anthony committed 2 years ago

Verified ac2c9ffa

Convert model parameters from generator to list. (#3017)

jomayeri committed 2 years ago

Verified 94f7da26

Older