microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into samyamr/fix-for-fragmented-linear-inputs

jeffra committed 4 years ago

Verified 0d9fc3ba

Add space in help string (#926)

tma15 committed 4 years ago

Verified ce14cf1a

Add link to AML examples. (#916)

awan-10 committed 4 years ago

Verified ab5534fc

disable pipe test (#915)

jeffra committed 4 years ago

Verified 8db4fdf8

Merge branch 'master' into samyamr/fix-for-fragmented-linear-inputs

jeffra committed 4 years ago

Verified 54ccc041

zero.Init() clarification (#880)

stas00 committed 4 years ago

Verified 5d721e09

Merge branch 'master' into samyamr/fix-for-fragmented-linear-inputs

jeffra committed 4 years ago

Verified 8ea1f5f1

[website] we're hiring!

jeffra committed 4 years ago

Verified c814abda

[website] We're hiring! + integration posts

jeffra committed 4 years ago

Verified c6b497df

We're hiring! + integration posts

jeffra committed 4 years ago

Verified 8c9e16eb

Bump kramdown from 2.3.0 to 2.3.1 in /docs (#905)

dependabot[bot] committed 4 years ago

Verified c0422642

update backward api doc (#903)

jeffra committed 4 years ago

Verified 23ff6cb7

update kramdown (#901)

jeffra committed 4 years ago

Verified af2d8fc5

Merge branch 'master' into samyamr/fix-for-fragmented-linear-inputs

tjruwase committed 4 years ago

Verified 27bd006c

Fix zero stage2 cpu_offload when some model trainable parameters skipped in training (#861)

ghosthamlet committed 4 years ago

Verified 7fcc8911

save_fp16_model consolidated for zero3 (#893)

stas00 committed 4 years ago

Verified 39013dd2

full fp32 weights reconstruction for zero 2+3 (#892)

stas00 committed 4 years ago

Verified 7531c6bf

[debug utils] see_memory_usage fixes (#890)

stas00 committed 4 years ago

Verified 7f03282c

[doc] pipeline (#888)

stas00 committed 4 years ago

Verified 22d5a1f3

Enable memory efficient linear when ZeRO 3 model is initialized in Stage 3 initialize instead of using deepspeed.init

samyam committed 4 years ago

79b81eda

Fix for fragmented linear inputs in ZeRO 3 Linear layers where reshape is needed instead of view. Should not affect performance for cases which only requires view since reshape will just do view when possible

samyam committed 4 years ago

e193901a

[doc] launcher (#868)

stas00 committed 4 years ago

Verified 9e9f8cbe

consistent checkpoint filenaming (#865)

stas00 committed 4 years ago

Verified 10c0bea6

1-bit Adam v2 (#817)

conglongli committed 4 years ago

Verified 68c8481b

bump version 0.3.13

jeffra committed 4 years ago

12a53b43

Make config objects json serializable (#862)

tjruwase committed 4 years ago

Verified 7bcd72a2

Fix ZeRO3 save_checkpoint (#857)

tjruwase committed 4 years ago

Verified fa87a73a

Allow args to be optional in deepspeed.initialize (#825)

jeffra committed 4 years ago

Verified 871f3048

docs: minor spelling tweaks (#858)

brettkoonce committed 4 years ago

Verified 547d1c5f

[runner/launch] propagate the error (#854)

stas00 committed 4 years ago

Verified 24335d49

Older