microsoft/DeepSpeed

Pull Requests Commits

Add Linear warmup+decay lr schedule (#414)

tjruwase committed 5 years ago

Verified 0e942df0

add cpu-adam, reformat, add colors (#413)

jeffra committed 5 years ago

Verified a9e8325f

fix bug related to stitching reduced grads across communication partitions (#318)

jeffra committed 5 years ago

Verified 55ed1057

pytest skips for tests requiring certain ops (#411)

jeffra committed 5 years ago

Verified 91b4a93d

scales throughput by logging freq (#408)

Shaden Smith committed 5 years ago

Verified 473ff985

Revert "supporting different intermediate sizes other than 4 * hidden_dim (#389)" (#404)

jeffra committed 5 years ago

Verified 4ac9bf60

supporting different intermediate sizes other than 4 * hidden_dim (#389)

RezaYazdaniAminabadi committed 5 years ago

Verified e549be60

readthedocs upgrade (#402)

Shaden Smith committed 5 years ago

Verified c82756cd

remove old pt file

jeffra committed 5 years ago

15ca99c6

Update ZeRO-Offload blog post link (#401)

tjruwase committed 5 years ago

Verified d15015e9

Update news site with press release link

jeffra committed 5 years ago

Verified 5dc4d6c7

Update _config.yml

jeffra committed 5 years ago

Verified ea92ed29

Update README.md

jeffra committed 5 years ago

Verified 96935958

bump DSE and doc tweak

jeffra committed 5 years ago

4b1df25a

only add 1bit adam reqs if mpi is installed, update cond build for cpu-adam (#400)

jeffra committed 5 years ago

Verified 240ea97b

update docker image and bump DSE

jeffra committed 5 years ago

b29229bf

Website edits (#398)

Shaden Smith committed 5 years ago

Verified 6bb5c69f

Update README.md

jeffra committed 5 years ago

Verified 7baf3c3a

Landing page updates (#395)

jeffra committed 5 years ago

Verified a8a8b3d2

Adding sparse attention news index item (#376)

arashashari committed 5 years ago

Verified c76769c4

Minjiaz/zero offload (#382)

minjiaz committed 5 years ago

Verified 59ce90d0

Sparse attention: updating code tag in documentation (#394)

arashashari committed 5 years ago

Verified be4b94be

fix for 16GB v100 nodes (#393)

jeffra committed 5 years ago

Verified b1d4bd73

ZeRO tutorials (#384)

tjruwase committed 5 years ago

Verified 2dea61f2

Add openmpi to dockerfile

jeffra committed 5 years ago

Verified c0d5424f

Fix datatype issue with sparse attention softmax (#363)

jeffra committed 5 years ago

Verified dca0b784

Update documentation for 1-bit Adam (#388)

awan-10 committed 5 years ago

Verified 093f09ff

Pipeline parallel training engine. (#392)

Shaden Smith committed 5 years ago

Verified 65c2f974

ZeRO-Offload release (#391)

jeffra committed 5 years ago

Verified 41db1c2f

Update test triggers to exclude docs

jeffra committed 5 years ago

Verified 79093d74

Newer Older