microsoft/DeepSpeed

Pull Requests Commits

Samyamr/stage 3 skip modules without parameters (#922)

jeffra committed 4 years ago

0eea7b82

Samyamr/fix for fragmented linear inputs (#921)

jeffra committed 4 years ago

cf735df2

Gathered parameters list (#920)

jeffra committed 4 years ago

c0ebbb1a

Fix adam leak (#918)

jeffra committed 4 years ago

03629e3f

zero.Init() clarification (#880)

stas00 committed 4 years ago

Verified 5d721e09

[website] we're hiring!

jeffra committed 4 years ago

Verified c814abda

[website] We're hiring! + integration posts

jeffra committed 4 years ago

Verified c6b497df

We're hiring! + integration posts

jeffra committed 4 years ago

Verified 8c9e16eb

Bump kramdown from 2.3.0 to 2.3.1 in /docs (#905)

dependabot[bot] committed 4 years ago

Verified c0422642

update backward api doc (#903)

jeffra committed 4 years ago

Verified 23ff6cb7

update kramdown (#901)

jeffra committed 4 years ago

Verified af2d8fc5

Fix zero stage2 cpu_offload when some model trainable parameters skipped in training (#861)

ghosthamlet committed 4 years ago

Verified 7fcc8911

save_fp16_model consolidated for zero3 (#893)

stas00 committed 4 years ago

Verified 39013dd2

full fp32 weights reconstruction for zero 2+3 (#892)

stas00 committed 4 years ago

Verified 7531c6bf

[debug utils] see_memory_usage fixes (#890)

stas00 committed 4 years ago

Verified 7f03282c

[doc] pipeline (#888)

stas00 committed 4 years ago

Verified 22d5a1f3

[doc] launcher (#868)

stas00 committed 4 years ago

Verified 9e9f8cbe

consistent checkpoint filenaming (#865)

stas00 committed 4 years ago

Verified 10c0bea6

1-bit Adam v2 (#817)

conglongli committed 4 years ago

Verified 68c8481b

bump version 0.3.13

jeffra committed 4 years ago

12a53b43

Make config objects json serializable (#862)

tjruwase committed 4 years ago

Verified 7bcd72a2

Fix ZeRO3 save_checkpoint (#857)

tjruwase committed 4 years ago

Verified fa87a73a

Allow args to be optional in deepspeed.initialize (#825)

jeffra committed 4 years ago

Verified 871f3048

docs: minor spelling tweaks (#858)

brettkoonce committed 4 years ago

Verified 547d1c5f

[runner/launch] propagate the error (#854)

stas00 committed 4 years ago

Verified 24335d49

ZeRO Stage 2: Clear reduced gradients (#856)

tjruwase committed 4 years ago

Verified a75d971b

Samyamr/inference hook fix (#851)

samyam committed 4 years ago

Verified 46018859

[doc] pipeline doc typos/improvements (#659)

stas00 committed 4 years ago

Verified 73d762c8

Bug fix: Remove client optimizer param_group list item that does not have 'params' (#827)

cli99 committed 4 years ago

Verified 458ff028

bump to v0.3.12

jeffra committed 4 years ago

35fd7ccd

Older