microsoft/DeepSpeed

Pull Requests Commits

Link lp/hp/optim state; Refresh links after checkpoint load

tjruwase committed 3 years ago

4e8f7fff

lp to hp mapping

tjruwase committed 3 years ago

20697bc4

Merge branch 'olruwase/bf16-updates' of github.com:microsoft/DeepSpeed into olruwase/bf16-updates

tjruwase committed 3 years ago

88cdf61c

Also clip all tp rank parameters

tjruwase committed 3 years ago

e24814a1

Merge branch 'master' into olruwase/bf16-updates

tjruwase committed 3 years ago

Verified 4e1dcfd1

Update config-json.md (#1853)

xldrx committed 3 years ago

Verified b61d7199

deepscale --> deepspeed in prints. (#1854)

awan-10 committed 3 years ago

Verified 788e1c40

add amd release blog (#1848)

jeffra committed 3 years ago

Verified 0eb2c763

Merge branch 'master' into olruwase/bf16-updates

tjruwase committed 3 years ago

Verified 6a4d6e67

Add concurrency policy to CI workflow (#1844)

mrwyattii committed 3 years ago

Verified 2e1847d6

Merge branch 'master' into olruwase/bf16-updates

tjruwase committed 3 years ago

Verified 67ea260f

Track only trainable parameters (#1780)

tjruwase committed 3 years ago

Verified b84edef2

Merge branch 'olruwase/bf16-updates' of github.com:microsoft/DeepSpeed into olruwase/bf16-updates

tjruwase committed 3 years ago

a4cbf0c1

Merge branch 'master' into olruwase/bf16-updates

tjruwase committed 3 years ago

Verified 2cd21f15

fix: Fix undefined variable in _create_expert_data_and_model_parallel and make it easier to understand (#1826)

shjwudp committed 3 years ago

Verified 1e61c7a8

Simplify tied weights reduction logic

tjruwase committed 3 years ago

2aa612a6

fix: fix undefined variable in MoE top2gating (#1827)

shjwudp committed 3 years ago

Verified 5fb4256a

Merge branch 'master' into olruwase/bf16-updates

jeffra committed 3 years ago

Verified 7e7fa60b

THCGeneral.h header file is deprecated (#1842)

rraminen committed 3 years ago

Verified b4e8f18c

Merge branch 'master' into olruwase/bf16-updates

jeffra committed 3 years ago

Verified 71499a8a

[ZeRO-1] fix bug w. cpu-offload + > 1 GPU (#1841)

jeffra committed 3 years ago

Verified 28434c00

Merge branch 'master' into olruwase/bf16-updates

tjruwase committed 3 years ago

Verified 86fa437d

[build] support cuda-11.6 (#1836)

stas00 committed 3 years ago

Verified 18ea8b79

Merge branch 'master' into olruwase/bf16-updates

jeffra committed 3 years ago

Verified 20fdba35

Split github action unit tests by platform/GPU (#1828)

mrwyattii committed 3 years ago

Verified 41d90830

[launcher] validate passwordless-ssh works when using hostfile launching (#1832)

jeffra committed 3 years ago

Verified a773996d

Reduce specified gradients (#1818)

tjruwase committed 3 years ago

Verified 89b8c887

Tune webpage width (#1829)

cli99 committed 3 years ago

Verified 8a35daf0

[website] remove extra news header

jeffra committed 3 years ago

Verified 9bc296e1

Website posts and tutorial improvements (#1799)

cli99 committed 3 years ago

Verified 908d6160

Older