microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into olruwase/zero2_trainable_parameters

jeffra committed 3 years ago

Verified ce851db2

fix: Fix undefined variable in _create_expert_data_and_model_parallel and make it easier to understand (#1826)

shjwudp committed 3 years ago

Verified 1e61c7a8

Merge branch 'master' into olruwase/zero2_trainable_parameters

tjruwase committed 3 years ago

Verified 4fb83517

fix: fix undefined variable in MoE top2gating (#1827)

shjwudp committed 3 years ago

Verified 5fb4256a

THCGeneral.h header file is deprecated (#1842)

rraminen committed 3 years ago

Verified b4e8f18c

[ZeRO-1] fix bug w. cpu-offload + > 1 GPU (#1841)

jeffra committed 3 years ago

Verified 28434c00

[build] support cuda-11.6 (#1836)

stas00 committed 3 years ago

Verified 18ea8b79

Split github action unit tests by platform/GPU (#1828)

mrwyattii committed 3 years ago

Verified 41d90830

[launcher] validate passwordless-ssh works when using hostfile launching (#1832)

jeffra committed 3 years ago

Verified a773996d

Merge branch 'master' into olruwase/zero2_trainable_parameters

tjruwase committed 3 years ago

Verified 73e0e22a

Reduce specified gradients (#1818)

tjruwase committed 3 years ago

Verified 89b8c887

Merge branch 'master' into olruwase/zero2_trainable_parameters

tjruwase committed 3 years ago

Verified 842ade76

Tune webpage width (#1829)

cli99 committed 3 years ago

Verified 8a35daf0

[website] remove extra news header

jeffra committed 3 years ago

Verified 9bc296e1

Website posts and tutorial improvements (#1799)

cli99 committed 3 years ago

Verified 908d6160

Merge branch 'master' into olruwase/zero2_trainable_parameters

tjruwase committed 3 years ago

Verified bc8f51ae

Enable CG headers on ROCm (#1821)

rraminen committed 3 years ago

Verified 7bcb4fab

01 adam optimizer (#1790)

EugeneLYC committed 3 years ago

Verified b80e5624

[docker] simplify and update rocm dockerfile (#1819)

jeffra committed 3 years ago

Verified ac71a1a4

Merge branch 'master' into olruwase/zero2_trainable_parameters

tjruwase committed 3 years ago

Verified d4ddba41

update gemfile (#1817)

jeffra committed 3 years ago

Verified 097efeb7

jeffra committed 3 years ago

013df6a9

force amd install via sudo (#1815)

jeffra committed 3 years ago

Verified a32e9b33

Invoke hipify from op builder for JIT extension builds (#1807)

jithunnair-amd committed 3 years ago

Verified 350d74ca

add GitHub URL for PyPi (#1812)

andriyor committed 3 years ago

Verified d7684f4e

Refactor moe/non-moe gradient reduction (#1811)

tjruwase committed 3 years ago

Verified 9f7126fc

Synchronize the GPUs for the text-generation inference test (#1805)

RezaYazdaniAminabadi committed 3 years ago

Verified 60fc06c6

AMD support (#1430)

jeffra committed 3 years ago

Verified c3c8d5dd

Minjiaz/mos doc (#1802)

awan-10 committed 3 years ago

Verified f0304bd1

bump DSE to latest commit

jeffra committed 3 years ago

3401d251

Older