microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into reyazda/adam-scalar-fix

jeffra committed 4 years ago

Verified bd3c9aab

Fix transformer kernel CUDA illegal memory access error (#765)

conglongli committed 4 years ago

Verified 1fcc5f7a

[dist] set args.local_rank to LOCAL_RANK (#764)

jeffra committed 4 years ago

Verified 68e138b6

Fix NameError: name 'dist' is not defined (#763)

tma15 committed 4 years ago

Verified 8067efa4

Minor doc tweaks (#761)

tjruwase committed 4 years ago

Verified c28a71f9

Checks for None tensors and skip them when splitting the buckets in zero stage 2. (#728)

cli99 committed 4 years ago

Verified 7cab55c7

Activation checkpointing for non-tensor arguments and return values (#741)

tjruwase committed 4 years ago

Verified ec8b1cb0

[install] add -e/--examples flag to checkout submodules (#755)

jeffra committed 4 years ago

Verified 7bf1b837

[install] fixes/improvements/docs (#752)

stas00 committed 4 years ago

Verified 78e776a9

Replace timer print rank 0 with logging (#732)

Sean Naren committed 4 years ago

Verified 6fb16100

1-bit Adam documentation fix (#747)

conglongli committed 4 years ago

Verified 248f6383

fix spelling mistake (#749)

sdtblck committed 4 years ago

Verified 1b8ca8ec

Only initialize distributed if required (#734)

Sean Naren committed 4 years ago

Verified 59eed176

Add flops profiler tutorial (#682)

cli99 committed 4 years ago

Verified e2dfe0d1

Clickable screenshots (#746)

tjruwase committed 4 years ago

Verified 6ee3b296

1bit_adam dependencies (#742)

stas00 committed 4 years ago

Verified 6beca3ce

Fixed typo in Readme. (#737)

TheDudeFromCI committed 4 years ago

Verified c5b3f40e

Merge branch 'master' into reyazda/adam-scalar-fix

RezaYazdaniAminabadi committed 4 years ago

Verified efec7a29

move stream synchronize in class method

Reza Yazdani committed 4 years ago

e347b648

guarding the tiled-copy overlapping

Reza Yazdani committed 4 years ago

d3dbec7e

Improve starred expressions (#696)

joneyolfson committed 4 years ago

Verified b08aa6f3

continue to copy in tiled manner when in scalar mode

Reza Yazdani committed 4 years ago

feaf2481

[launcher] look ma, no more zombies (#714)

stas00 committed 4 years ago

Verified 4f1d827c

jeffra committed 4 years ago

72b23ea3

local rank of -1 means not set (#720)

jeffra committed 4 years ago

Verified 45c33ee5

Add executable permission to `ds_elastic` and `ds_report` in `bin`. (#711)

joneyolfson committed 4 years ago

Verified 6332e313

properly set engine.local_rank if it's set to -1

jeffra committed 4 years ago

3cecbc1d

set_batch_fn and remove old sanity check (#712)

Shaden Smith committed 4 years ago

Verified 5e522efc

Dist testing backend fixes, etc. (#708)

jeffra committed 4 years ago

Verified 2e2dd861

[transformer-kernel] turn off unit test printing (#701)

jeffra committed 4 years ago

Verified 91b1b7f3

Older