microsoft/DeepSpeed

Pull Requests Commits

Enable contiguous gradients for cpu_offload

tjruwase committed 5 years ago

ea5b9918

Import path fixes + conditional imports (#358)

jeffra committed 5 years ago

Verified 130dd70b

Samyamr/zero offload correctness (#359)

samyam committed 5 years ago

Verified af512117

make the adam unit test work with random params and grads and for more steps

Reza Yazdani committed 5 years ago

504a643b

add cpu adam optimizer (#356)

RezaYazdaniAminabadi committed 5 years ago

Verified 20c414d0

Correctness and perf fixes (#354)

tjruwase committed 5 years ago

Verified 6604a5da

Assert ZeRO-Offload+gradient accumulation (#347)

tjruwase committed 5 years ago

Verified 0159ebba

update DSE to staging for zero-dual

jeffra committed 5 years ago

75d70a9f

ZeRO-Offload v1 (squash) (#345)

jeffra committed 5 years ago

e45b5e4c

update DSE and rename SA tests

jeffra committed 5 years ago

1661e830

Update Dockerfile

jeffra committed 5 years ago

Verified 5518aae5

Update Dockerfile

jeffra committed 5 years ago

Verified 87165403

Sparse attn + ops/runtime refactor + v0.3.0 (#343)

jeffra committed 5 years ago

Verified e5bbc2e5

Switches BBS example to use mbsize=3 and gas=2 to fit in 16GB of memory. (#341)

Shaden Smith committed 5 years ago

Verified 838f53b7

Update .gitignore

jeffra committed 5 years ago

Verified e8dd47df

Update run_func_test.py

samyam committed 5 years ago

Verified f4726b75

Rename ds_config_func_bs8_zero0_gas10.json to ds_config_func_bs8_zero0_gas3.json

samyam committed 5 years ago

Verified 6122a74e

Rename ds_config_func_bs8_zero2_gas10.json to ds_config_func_bs8_zero2_gas3.json

samyam committed 5 years ago

Verified 7a356b28

Samyamr/grad acc stage2 (#338)

samyam committed 5 years ago

Verified 7240abf3

Update deepspeed_checkpointing.py (#336)

samyam committed 5 years ago

Verified 458c0d92

jeffra committed 5 years ago

6823db32

Add code owners for DeepSpeed team (#335)

jeffra committed 5 years ago

Verified 21d5f634

Turn off multi-node launch if only 1 node (#322)

jeffra committed 5 years ago

Verified e69b1eec

bump DSE (#317)

jeffra committed 5 years ago

Verified de0523d4

attach empty grad to its param to ensure it's copied after reduction (#316)

jeffra committed 5 years ago

Verified e1bea67f

Update fan out flag for pdsh (#315)

jeffra committed 5 years ago

Verified 6855ba1c

Update deepspeed_lr_schedules.py (#314)

jeffra committed 5 years ago

Verified 3437342c

bumping DSE commit for pillow security fix (#312)

Shaden Smith committed 5 years ago

Verified 892ece67

Fix+tests for get_lr from lr_scheduler before training starts (#310)

jeffra committed 5 years ago

Verified cd68e6e5

updates website gems after kramdown alert (#311)

Shaden Smith committed 5 years ago

Verified 903a41a5

Newer Older