microsoft/DeepSpeed

Pull Requests Commits

Unit tests for activation checkpointing arbitrary inputs/outputs

tjruwase committed 4 years ago

cf4d815f

Merge branch 'master' of github.com:microsoft/DeepSpeed into olruwase/dynamic_graph_activation_checkpoint

tjruwase committed 4 years ago

4248f5bf

Fixed typo in Readme. (#737)

TheDudeFromCI committed 4 years ago

Verified c5b3f40e

Improve starred expressions (#696)

joneyolfson committed 4 years ago

Verified b08aa6f3

[launcher] look ma, no more zombies (#714)

stas00 committed 4 years ago

Verified 4f1d827c

jeffra committed 4 years ago

72b23ea3

local rank of -1 means not set (#720)

jeffra committed 4 years ago

Verified 45c33ee5

Add executable permission to `ds_elastic` and `ds_report` in `bin`. (#711)

joneyolfson committed 4 years ago

Verified 6332e313

properly set engine.local_rank if it's set to -1

jeffra committed 4 years ago

3cecbc1d

Formatting fixes'

tjruwase committed 4 years ago

e5cd785b

Merge API improvement

tjruwase committed 4 years ago

e00b0912

tjruwase committed 4 years ago

bb5da2e0

Simply checkpoint API (#719)

tjruwase committed 4 years ago

Verified 53c54048

set_batch_fn and remove old sanity check (#712)

Shaden Smith committed 4 years ago

Verified 5e522efc

Dist testing backend fixes, etc. (#708)

jeffra committed 4 years ago

Verified 2e2dd861

[transformer-kernel] turn off unit test printing (#701)

jeffra committed 4 years ago

Verified 91b1b7f3

Update torch16.yml

jeffra committed 4 years ago

Verified cd29f8b8

Create torch16.yml (#699)

jeffra committed 4 years ago

Verified 7833aed2

Fix wrong idx bug in invertible LayerNormBackward1 (#692)

Taka152 committed 4 years ago

Verified 5221832e

Merge with parent branch; Activation checkpointing support non-tensor args/return values

tjruwase committed 4 years ago

54fd5317

Add optional timeout parameter to deepspeed.init_distributed (#637)

sdtblck committed 4 years ago

Verified 852c524a

Fix ZeRO 2 + Pipelining (#677)

leogao2 committed 4 years ago

Verified 34c83a5a

make test_pipe more stable (#683)

Shaden Smith committed 4 years ago

Verified e59ba12d

[tutorials] typos (#676)

stas00 committed 4 years ago

Verified 7b0bee0b

add zero-offload paper (#680)

jeffra committed 4 years ago

Verified 82cecf69

stas00 committed 4 years ago

Verified 7b07e123

add missing config menu entries (#652)

stas00 committed 4 years ago

Verified e729a3fd

Add AdamW to the supported optimizers (#672)

stas00 committed 4 years ago

Verified c5e42641

skip empty lines in hostfile (#669)

jeffra committed 4 years ago

Verified 6217a6c2

Support optimizer AdamW type (#670)

tjruwase committed 4 years ago

Verified 865104be

Older