microsoft/DeepSpeed

Pull Requests Commits

tjruwase committed 4 years ago

c47bd9f0

Merge branch 'olruwase/zero3_amp_autocast' of github.com:microsoft/DeepSpeed into olruwase/zero3_amp_autocast

tjruwase committed 4 years ago

7d9d8c6a

tjruwase committed 4 years ago

3002983c

Merge branch 'master' into olruwase/zero3_amp_autocast

tjruwase committed 4 years ago

Verified 41d6313c

Merge branch 'olruwase/zero3_amp_autocast' of github.com:microsoft/DeepSpeed into olruwase/zero3_amp_autocast

tjruwase committed 4 years ago

3bb825b8

Add autocast unit test

tjruwase committed 4 years ago

7aefbfdf

Asynchronous I/O docs (#1000)

tjruwase committed 4 years ago

Verified bff4bc72

[doc] add missing pin_memory entry (#999)

stas00 committed 4 years ago

Verified ecf2e1bc

Fix issue where gradient_predivide_factor was called as a func. (#996)

wbuchwalter committed 4 years ago

Verified a7118789

Merge branch 'master' into olruwase/zero3_amp_autocast

jeffra committed 4 years ago

Verified 6742f30f

Add nvme unit/perf tests (#993)

tjruwase committed 4 years ago

Verified cf5ea891

Merge branch 'master' into olruwase/zero3_amp_autocast

tjruwase committed 4 years ago

Verified 046d97ac

Fix all Pipeline Module Parameters being sent to cuda:0 (#687)

sdtblck committed 4 years ago

Verified 669028f0

Make reduce scatter optional for ZeRO-1 as workaround (#971)

tjruwase committed 4 years ago

Verified 0b80ad06

Merge branch 'master' into olruwase/zero3_amp_autocast

tjruwase committed 4 years ago

Verified fe89f5e5

Use odd shape tensor to represent parameter data in partitioned state (#981)

cli99 committed 4 years ago

Verified 894f21da

CI breaks on torch.distributed

tjruwase committed 4 years ago

4d55855c

Handle specific exceptions

tjruwase committed 4 years ago

592f11ff

Merge branch 'olruwase/zero3_amp_autocast' of github.com:microsoft/DeepSpeed into olruwase/zero3_amp_autocast

tjruwase committed 4 years ago

0bc57183

tjruwase committed 4 years ago

6b8f4868

Merge branch 'master' into olruwase/zero3_amp_autocast

tjruwase committed 4 years ago

Verified a48b85df

Use amp autocast in ZeRO3 linear

tjruwase committed 4 years ago

8d340d05

1-bit LAMB optimizer (#970)

conglongli committed 4 years ago

Verified 67a48aaa

remove debug prints: (#986)

stas00 committed 4 years ago

Verified eecef309

make bold+italic work without escaping _ (#775)

stas00 committed 4 years ago

Verified 835b4c87

[ZeRO Infinity] Allow Init to take a dict for the deepspeed config (#983)

Sean Naren committed 4 years ago

Verified 35251023

add option to force multi-node launcher mode (#977)

jeffra committed 4 years ago

Verified 9e0dab40

assert no Z2/Z3 with pipeline and fix some docs links (#980)

Shaden Smith committed 4 years ago

Verified fbece50b

jeffra committed 4 years ago

2c2a7f31

[docs] zero-inf updates

jeffra committed 4 years ago

5f570bbc

Older