microsoft/DeepSpeed

Pull Requests Commits

bump version 0.3.13

jeffra committed 4 years ago

12a53b43

Make config objects json serializable (#862)

tjruwase committed 4 years ago

Verified 7bcd72a2

Fix ZeRO3 save_checkpoint (#857)

tjruwase committed 4 years ago

Verified fa87a73a

Allow args to be optional in deepspeed.initialize (#825)

jeffra committed 4 years ago

Verified 871f3048

docs: minor spelling tweaks (#858)

brettkoonce committed 4 years ago

Verified 547d1c5f

[runner/launch] propagate the error (#854)

stas00 committed 4 years ago

Verified 24335d49

ZeRO Stage 2: Clear reduced gradients (#856)

tjruwase committed 4 years ago

Verified a75d971b

Samyamr/inference hook fix (#851)

samyam committed 4 years ago

Verified 46018859

[doc] pipeline doc typos/improvements (#659)

stas00 committed 4 years ago

Verified 73d762c8

Bug fix: Remove client optimizer param_group list item that does not have 'params' (#827)

cli99 committed 4 years ago

Verified 458ff028

bump to v0.3.12

jeffra committed 4 years ago

35fd7ccd

[WarmupDecayLR] fix log(0) & 1/log(1) bugs (#772)

stas00 committed 4 years ago

Verified 18a26f3f

Control ZeRO wall clock timers (#849)

tjruwase committed 4 years ago

Verified 311795d0

small tweaks (#839)

stas00 committed 4 years ago

Verified 7925d0c3

Add optimizers and schedules to RTD and updated the corresponding part in the website (#799)

cli99 committed 4 years ago

Verified e0f36ed5

less scary overflow notice (#833)

stas00 committed 4 years ago

Verified 29853c3e

set adamw_mode default true (follows FusedAdam and < 0.3.11 logic) (#844)

jeffra committed 4 years ago

Verified dd03cff2

bumping DSE pointer (#847)

Shaden Smith committed 4 years ago

Verified 564eb4bd

Fix regression in runner (#843)

jeffra committed 4 years ago

Verified 2e6692c8

replace home env with ~

jeffra committed 4 years ago

Verified 49496364

Model scale changing 5x to 3x

samyam committed 4 years ago

Verified 6adc19a6

jeffra committed 4 years ago

Verified af548971

bump DSE to include ZeRO-3

jeffra committed 4 years ago

9c5eee3d

Fix zero3 tutorial link

jeffra committed 4 years ago

Verified 75ffdaf7

update tutorial/doc links for zero3 (#835)

jeffra committed 4 years ago

Verified d7de9165

ZeRO 3 Offload (#834)

samyam committed 4 years ago

Verified 599258f9

Update ZeRO-Offload tutorials (#824)

tjruwase committed 4 years ago

Verified ba33e86e

Fixing gelu_checkpointing memory issue (#812)

RezaYazdaniAminabadi committed 4 years ago

Verified 8295d7a8

issue with the implementation of column_sum_reduce (#804)

zmxdream committed 4 years ago

Verified 937c5cee

fixed typo (#802)

vfdev-5 committed 4 years ago

Verified db987cf1

Newer Older