microsoft/DeepSpeed

Pull Requests Commits

reshape the mask using its own size

Reza Yazdani committed 4 years ago

f1dc02db

fix compile issues

Reza Yazdani committed 4 years ago

03919104

Adding the new version of SoftMax to supprot Triangular mask used in GPT-based models

Reza Yazdani committed 4 years ago

52100226

Add space in help string (#926)

tma15 committed 4 years ago

Verified ce14cf1a

Add link to AML examples. (#916)

awan-10 committed 4 years ago

Verified ab5534fc

disable pipe test (#915)

jeffra committed 4 years ago

Verified 8db4fdf8

zero.Init() clarification (#880)

stas00 committed 4 years ago

Verified 5d721e09

[website] we're hiring!

jeffra committed 4 years ago

Verified c814abda

[website] We're hiring! + integration posts

jeffra committed 4 years ago

Verified c6b497df

We're hiring! + integration posts

jeffra committed 4 years ago

Verified 8c9e16eb

Bump kramdown from 2.3.0 to 2.3.1 in /docs (#905)

dependabot[bot] committed 4 years ago

Verified c0422642

update backward api doc (#903)

jeffra committed 4 years ago

Verified 23ff6cb7

update kramdown (#901)

jeffra committed 4 years ago

Verified af2d8fc5

Fix zero stage2 cpu_offload when some model trainable parameters skipped in training (#861)

ghosthamlet committed 4 years ago

Verified 7fcc8911

save_fp16_model consolidated for zero3 (#893)

stas00 committed 4 years ago

Verified 39013dd2

full fp32 weights reconstruction for zero 2+3 (#892)

stas00 committed 4 years ago

Verified 7531c6bf

[debug utils] see_memory_usage fixes (#890)

stas00 committed 4 years ago

Verified 7f03282c

[doc] pipeline (#888)

stas00 committed 4 years ago

Verified 22d5a1f3

[doc] launcher (#868)

stas00 committed 4 years ago

Verified 9e9f8cbe

consistent checkpoint filenaming (#865)

stas00 committed 4 years ago

Verified 10c0bea6

1-bit Adam v2 (#817)

conglongli committed 4 years ago

Verified 68c8481b

bump version 0.3.13

jeffra committed 4 years ago

12a53b43

Make config objects json serializable (#862)

tjruwase committed 4 years ago

Verified 7bcd72a2

Fix ZeRO3 save_checkpoint (#857)

tjruwase committed 4 years ago

Verified fa87a73a

Allow args to be optional in deepspeed.initialize (#825)

jeffra committed 4 years ago

Verified 871f3048

docs: minor spelling tweaks (#858)

brettkoonce committed 4 years ago

Verified 547d1c5f

[runner/launch] propagate the error (#854)

stas00 committed 4 years ago

Verified 24335d49

ZeRO Stage 2: Clear reduced gradients (#856)

tjruwase committed 4 years ago

Verified a75d971b

Samyamr/inference hook fix (#851)

samyam committed 4 years ago

Verified 46018859

[doc] pipeline doc typos/improvements (#659)

stas00 committed 4 years ago

Verified 73d762c8

Older