microsoft/DeepSpeed

Pull Requests Commits

Compare ds_tensors

tjruwase committed 4 years ago

8cd046fa

Save ZeRO3 (partitioned) fp16 weights

tjruwase committed 4 years ago

856ab317

[doc] launcher (#868)

stas00 committed 4 years ago

Verified 9e9f8cbe

consistent checkpoint filenaming (#865)

stas00 committed 4 years ago

Verified 10c0bea6

1-bit Adam v2 (#817)

conglongli committed 4 years ago

Verified 68c8481b

bump version 0.3.13

jeffra committed 4 years ago

12a53b43

Make config objects json serializable (#862)

tjruwase committed 4 years ago

Verified 7bcd72a2

Fix ZeRO3 save_checkpoint (#857)

tjruwase committed 4 years ago

Verified fa87a73a

Allow args to be optional in deepspeed.initialize (#825)

jeffra committed 4 years ago

Verified 871f3048

docs: minor spelling tweaks (#858)

brettkoonce committed 4 years ago

Verified 547d1c5f

[runner/launch] propagate the error (#854)

stas00 committed 4 years ago

Verified 24335d49

ZeRO Stage 2: Clear reduced gradients (#856)

tjruwase committed 4 years ago

Verified a75d971b

Samyamr/inference hook fix (#851)

samyam committed 4 years ago

Verified 46018859

[doc] pipeline doc typos/improvements (#659)

stas00 committed 4 years ago

Verified 73d762c8

Bug fix: Remove client optimizer param_group list item that does not have 'params' (#827)

cli99 committed 4 years ago

Verified 458ff028

bump to v0.3.12

jeffra committed 4 years ago

35fd7ccd

[WarmupDecayLR] fix log(0) & 1/log(1) bugs (#772)

stas00 committed 4 years ago

Verified 18a26f3f

Control ZeRO wall clock timers (#849)

tjruwase committed 4 years ago

Verified 311795d0

small tweaks (#839)

stas00 committed 4 years ago

Verified 7925d0c3

Add optimizers and schedules to RTD and updated the corresponding part in the website (#799)

cli99 committed 4 years ago

Verified e0f36ed5

less scary overflow notice (#833)

stas00 committed 4 years ago

Verified 29853c3e

set adamw_mode default true (follows FusedAdam and < 0.3.11 logic) (#844)

jeffra committed 4 years ago

Verified dd03cff2

bumping DSE pointer (#847)

Shaden Smith committed 4 years ago

Verified 564eb4bd

Fix regression in runner (#843)

jeffra committed 4 years ago

Verified 2e6692c8

replace home env with ~

jeffra committed 4 years ago

Verified 49496364

Model scale changing 5x to 3x

samyam committed 4 years ago

Verified 6adc19a6

jeffra committed 4 years ago

Verified af548971

bump DSE to include ZeRO-3

jeffra committed 4 years ago

9c5eee3d

Fix zero3 tutorial link

jeffra committed 4 years ago

Verified 75ffdaf7

update tutorial/doc links for zero3 (#835)

jeffra committed 4 years ago

Verified d7de9165

Older