microsoft/DeepSpeed

Pull Requests Commits

Enable debug prints

tjruwase committed 4 years ago

d1110aed

Add gradient imbalance fix

tjruwase committed 4 years ago

0d3599e2

Add debug pirnts

tjruwase committed 4 years ago

e0fcd1c8

Merge branch 'master' of github.com:microsoft/DeepSpeed into master

tjruwase committed 4 years ago

06fbd7cc

Debug offload slowdown

tjruwase committed 4 years ago

4cca39db

[doc] launcher (#868)

stas00 committed 4 years ago

Verified 9e9f8cbe

consistent checkpoint filenaming (#865)

stas00 committed 4 years ago

Verified 10c0bea6

1-bit Adam v2 (#817)

conglongli committed 4 years ago

Verified 68c8481b

bump version 0.3.13

jeffra committed 4 years ago

12a53b43

Make config objects json serializable (#862)

tjruwase committed 4 years ago

Verified 7bcd72a2

Fix ZeRO3 save_checkpoint (#857)

tjruwase committed 4 years ago

Verified fa87a73a

Allow args to be optional in deepspeed.initialize (#825)

jeffra committed 4 years ago

Verified 871f3048

docs: minor spelling tweaks (#858)

brettkoonce committed 4 years ago

Verified 547d1c5f

[runner/launch] propagate the error (#854)

stas00 committed 4 years ago

Verified 24335d49

ZeRO Stage 2: Clear reduced gradients (#856)

tjruwase committed 4 years ago

Verified a75d971b

Samyamr/inference hook fix (#851)

samyam committed 4 years ago

Verified 46018859

[doc] pipeline doc typos/improvements (#659)

stas00 committed 4 years ago

Verified 73d762c8

Bug fix: Remove client optimizer param_group list item that does not have 'params' (#827)

cli99 committed 4 years ago

Verified 458ff028

bump to v0.3.12

jeffra committed 4 years ago

35fd7ccd

[WarmupDecayLR] fix log(0) & 1/log(1) bugs (#772)

stas00 committed 4 years ago

Verified 18a26f3f

Control ZeRO wall clock timers (#849)

tjruwase committed 4 years ago

Verified 311795d0

small tweaks (#839)

stas00 committed 4 years ago

Verified 7925d0c3

Add optimizers and schedules to RTD and updated the corresponding part in the website (#799)

cli99 committed 4 years ago

Verified e0f36ed5

less scary overflow notice (#833)

stas00 committed 4 years ago

Verified 29853c3e

set adamw_mode default true (follows FusedAdam and < 0.3.11 logic) (#844)

jeffra committed 4 years ago

Verified dd03cff2

bumping DSE pointer (#847)

Shaden Smith committed 4 years ago

Verified 564eb4bd

Fix regression in runner (#843)

jeffra committed 4 years ago

Verified 2e6692c8

replace home env with ~

jeffra committed 4 years ago

Verified 49496364

Model scale changing 5x to 3x

samyam committed 4 years ago

Verified 6adc19a6

jeffra committed 4 years ago

Verified af548971

Older