microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into SA_update_tutorial_link

jeffra committed 5 years ago

Verified c8886f1f

Add 1-bit Adam support to DeepSpeed (#380)

awan-10 committed 5 years ago

Verified 01726ce2

temp disable model tests

jeffra committed 5 years ago

Verified 234bba0c

fixing a link issue with SA tutorial

arashashari committed 5 years ago

d371b90b

adding sparse attention to feature index page (#377)

arashashari committed 5 years ago

Verified b73894de

Update Sparse Attention Tutorial (#357)

arashashari committed 5 years ago

Verified 9dadf38d

Update installation instructions (#362)

tjruwase committed 5 years ago

Verified 9e83ef21

Move code quality tests to Azure-hosted agents. (#368)

Shaden Smith committed 5 years ago

Verified 4d4eafbe

fixed a typo; this was fixed before but seems like it has been lost in the refactor (#364)

arashashari committed 5 years ago

Verified a64b0abb

Jekyll installation instructions (#351)

Shaden Smith committed 5 years ago

Verified ac12833e

Adding link to Sparse Attention in Navigation page (#355)

arashashari committed 5 years ago

Verified 6deac82c

Update test_sparse_attention.py

jeffra committed 5 years ago

Verified 1ebcd6c5

update DSE and rename SA tests

jeffra committed 5 years ago

1661e830

Update Dockerfile

jeffra committed 5 years ago

Verified 5518aae5

Update Dockerfile

jeffra committed 5 years ago

Verified 87165403

Sparse attn + ops/runtime refactor + v0.3.0 (#343)

jeffra committed 5 years ago

Verified e5bbc2e5

Switches BBS example to use mbsize=3 and gas=2 to fit in 16GB of memory. (#341)

Shaden Smith committed 5 years ago

Verified 838f53b7

Update .gitignore

jeffra committed 5 years ago

Verified e8dd47df

Update run_func_test.py

samyam committed 5 years ago

Verified f4726b75

Rename ds_config_func_bs8_zero0_gas10.json to ds_config_func_bs8_zero0_gas3.json

samyam committed 5 years ago

Verified 6122a74e

Rename ds_config_func_bs8_zero2_gas10.json to ds_config_func_bs8_zero2_gas3.json

samyam committed 5 years ago

Verified 7a356b28

Samyamr/grad acc stage2 (#338)

samyam committed 5 years ago

Verified 7240abf3

Update deepspeed_checkpointing.py (#336)

samyam committed 5 years ago

Verified 458c0d92

jeffra committed 5 years ago

6823db32

Add code owners for DeepSpeed team (#335)

jeffra committed 5 years ago

Verified 21d5f634

Turn off multi-node launch if only 1 node (#322)

jeffra committed 5 years ago

Verified e69b1eec

bump DSE (#317)

jeffra committed 5 years ago

Verified de0523d4

attach empty grad to its param to ensure it's copied after reduction (#316)

jeffra committed 5 years ago

Verified e1bea67f

Update fan out flag for pdsh (#315)

jeffra committed 5 years ago

Verified 6855ba1c

Update deepspeed_lr_schedules.py (#314)

jeffra committed 5 years ago

Verified 3437342c

Older