deepspeedai/DeepSpeed

Pull Requests Commits

Merge branch 'master' into samyamr/stage3-alignment-fix

jeffra committed 4 years ago

Verified 9349e157

Allow args to be optional in deepspeed.initialize (#825)

jeffra committed 4 years ago

Verified 871f3048

docs: minor spelling tweaks (#858)

brettkoonce committed 4 years ago

Verified 547d1c5f

[runner/launch] propagate the error (#854)

stas00 committed 4 years ago

Verified 24335d49

Merge branch 'master' into samyamr/stage3-alignment-fix

jeffra committed 4 years ago

Verified a636aabf

ZeRO Stage 2: Clear reduced gradients (#856)

tjruwase committed 4 years ago

Verified a75d971b

Samyamr/inference hook fix (#851)

samyam committed 4 years ago

Verified 46018859

[doc] pipeline doc typos/improvements (#659)

stas00 committed 4 years ago

Verified 73d762c8

Bug fix: Remove client optimizer param_group list item that does not have 'params' (#827)

cli99 committed 4 years ago

Verified 458ff028

bump to v0.3.12

jeffra committed 4 years ago

35fd7ccd

[WarmupDecayLR] fix log(0) & 1/log(1) bugs (#772)

stas00 committed 4 years ago

Verified 18a26f3f

Control ZeRO wall clock timers (#849)

tjruwase committed 4 years ago

Verified 311795d0

small tweaks (#839)

stas00 committed 4 years ago

Verified 7925d0c3

Add optimizers and schedules to RTD and updated the corresponding part in the website (#799)

cli99 committed 4 years ago

Verified e0f36ed5

less scary overflow notice (#833)

stas00 committed 4 years ago

Verified 29853c3e

set adamw_mode default true (follows FusedAdam and < 0.3.11 logic) (#844)

jeffra committed 4 years ago

Verified dd03cff2

bumping DSE pointer (#847)

Shaden Smith committed 4 years ago

Verified 564eb4bd

Fix regression in runner (#843)

jeffra committed 4 years ago

Verified 2e6692c8

Merge branch 'master' into samyamr/stage3-alignment-fix

jeffra committed 4 years ago

Verified da71a897

replace home env with ~

jeffra committed 4 years ago

Verified 49496364

formatting and adding back tests or Z3

samyam committed 4 years ago

097ef4b2

Fix memory alignment bug in Stage 3 that gets triggered when number of params are not multiple of the world size

samyam committed 4 years ago

bd9f3ef6

Model scale changing 5x to 3x

samyam committed 4 years ago

Verified 6adc19a6

jeffra committed 4 years ago

Verified af548971

bump DSE to include ZeRO-3

jeffra committed 4 years ago

9c5eee3d

Fix zero3 tutorial link

jeffra committed 4 years ago

Verified 75ffdaf7

update tutorial/doc links for zero3 (#835)

jeffra committed 4 years ago

Verified d7de9165

ZeRO 3 Offload (#834)

samyam committed 4 years ago

Verified 599258f9

Update ZeRO-Offload tutorials (#824)

tjruwase committed 4 years ago

Verified ba33e86e

Fixing gelu_checkpointing memory issue (#812)

RezaYazdaniAminabadi committed 4 years ago

Verified 8295d7a8

Older