microsoft/DeepSpeed

Pull Requests Commits

Simplify tied weights reduction logic

tjruwase committed 3 years ago

2aa612a6

Merge branch 'master' into olruwase/bf16-updates

jeffra committed 3 years ago

Verified 71499a8a

[ZeRO-1] fix bug w. cpu-offload + > 1 GPU (#1841)

jeffra committed 3 years ago

Verified 28434c00

Merge branch 'master' into olruwase/bf16-updates

tjruwase committed 3 years ago

Verified 86fa437d

[build] support cuda-11.6 (#1836)

stas00 committed 3 years ago

Verified 18ea8b79

Merge branch 'master' into olruwase/bf16-updates

jeffra committed 3 years ago

Verified 20fdba35

Split github action unit tests by platform/GPU (#1828)

mrwyattii committed 3 years ago

Verified 41d90830

[launcher] validate passwordless-ssh works when using hostfile launching (#1832)

jeffra committed 3 years ago

Verified a773996d

Reduce specified gradients (#1818)

tjruwase committed 3 years ago

Verified 89b8c887

Tune webpage width (#1829)

cli99 committed 3 years ago

Verified 8a35daf0

[website] remove extra news header

jeffra committed 3 years ago

Verified 9bc296e1

Website posts and tutorial improvements (#1799)

cli99 committed 3 years ago

Verified 908d6160

Merge branch 'master' into olruwase/bf16-updates

tjruwase committed 3 years ago

Verified ff99cb25

Enable CG headers on ROCm (#1821)

rraminen committed 3 years ago

Verified 7bcb4fab

Merge branch 'master' into olruwase/bf16-updates

tjruwase committed 3 years ago

Verified 4a505ecd

01 adam optimizer (#1790)

EugeneLYC committed 3 years ago

Verified b80e5624

Clip gradients of last stage tied weights

tjruwase committed 3 years ago

77b649d1

Link bf16 & fp32 params

tjruwase committed 3 years ago

19198688

[docker] simplify and update rocm dockerfile (#1819)

jeffra committed 3 years ago

Verified ac71a1a4

Remove optimizer restriction for bf16

tjruwase committed 3 years ago

b7d64fd7

Use O(n) instead of O(n^2)

tjruwase committed 3 years ago

ab61edb0

Merge branch 'olruwase/reduce_specified_gradients' of github.com:microsoft/DeepSpeed into olruwase/bf16-updates

tjruwase committed 3 years ago

89e054d8

Reduce specified gradients

tjruwase committed 3 years ago

de3616ca

Merge branch 'master' into olruwase/bf16-updates

jeffra committed 3 years ago

Verified 46cc2ce3

update gemfile (#1817)

jeffra committed 3 years ago

Verified 097efeb7

Merge branch 'master' into olruwase/bf16-updates

jeffra committed 3 years ago

Verified 3ee61cdb

jeffra committed 3 years ago

013df6a9

force amd install via sudo (#1815)

jeffra committed 3 years ago

Verified a32e9b33

Invoke hipify from op builder for JIT extension builds (#1807)

jithunnair-amd committed 3 years ago

Verified 350d74ca

add GitHub URL for PyPi (#1812)

andriyor committed 3 years ago

Verified d7684f4e

Older