microsoft/DeepSpeed

Pull Requests Commits

fix syntax error.

awan-10 committed 4 years ago

8adf83d7

refactor to use a config flag for auto_save_ckpt.

awan-10 committed 4 years ago

0df1fbc1

some minor fixes.

awan-10 committed 4 years ago

c00f871a

Add support for save_ckpt in auto elasticity.

awan-10 committed 4 years ago

05dd42fa

remove auto-ckpt for now, pending todo

jeffra committed 4 years ago

3dd34136

add mp detector, pass elastic vars to multinode

jeffra committed 4 years ago

27a199d4

add ssh agent ready check

jeffra committed 4 years ago

305885f9

jeffra committed 4 years ago

e0ce2ccb

support inotify and polling based scale detection

jeffra committed 4 years ago

622dc350

jeffra committed 4 years ago

c5d6bcdd

add divisible_by elastic param and cleanup

jeffra committed 4 years ago

fa87ed10

working in test scenarios, still further testing to be done

jeffra committed 4 years ago

4e87ef51

awan-10 committed 4 years ago

8abcef59

awan-10 committed 4 years ago

99f3abb6

awan-10 committed 4 years ago

bd0b4556

new design without inotify.

awan-10 committed 4 years ago

12303d06

Add some fixes to test.

awan-10 committed 4 years ago

dc3b097e

fixes to ckpt. and scale-down.

awan-10 committed 4 years ago

4a82d314

fix checks for mpu.

awan-10 committed 4 years ago

d5ebfb95

fix port issue.

awan-10 committed 4 years ago

b759e61f

several fixes. scale/up/down supported.

awan-10 committed 4 years ago

d4f36ae7

New design to test on RR1

awan-10 committed 4 years ago

e409ea5c

V0. Works but hangs :)

jeffra committed 4 years ago

f06c84b6

Add initial files for automatic elastic support.

jeffra committed 4 years ago

f755ecce

Allow args to be optional in deepspeed.initialize (#825)

jeffra committed 4 years ago

Verified 871f3048

docs: minor spelling tweaks (#858)

brettkoonce committed 4 years ago

Verified 547d1c5f

[runner/launch] propagate the error (#854)

stas00 committed 4 years ago

Verified 24335d49

ZeRO Stage 2: Clear reduced gradients (#856)

tjruwase committed 4 years ago

Verified a75d971b

Samyamr/inference hook fix (#851)

samyam committed 4 years ago

Verified 46018859

[doc] pipeline doc typos/improvements (#659)

stas00 committed 4 years ago

Verified 73d762c8

Older