microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into jeffra/fix-1416

jeffra committed 3 years ago

Verified dfdb9a78

Improve inference documentation (#1421)

aphedges committed 3 years ago

Verified aa8d97e6

Merge branch 'master' into jeffra/fix-1416

jeffra committed 3 years ago

Verified 8777ba03

Save the model parallel group at inference engine statically (#1411)

RezaYazdaniAminabadi committed 3 years ago

Verified 9f17087f

Merge branch 'master' into jeffra/fix-1416

jeffra committed 3 years ago

Verified 5c84d1a4

Fix typo in assert message (#1420)

manuelciosici committed 3 years ago

Verified 56124621

Merge branch 'master' into jeffra/fix-1416

jeffra committed 3 years ago

Verified 5f4b55c4

[CI] make build names consistent

jeffra committed 3 years ago

Verified a4ffc831

update docs for sparse-grads

jeffra committed 3 years ago

52ea6ea1

add assert to ensure we dont skip unsupported grad dtypes

jeffra committed 3 years ago

c6bc2fa8

[ci] hf dependencies (#1417)

stas00 committed 3 years ago

Verified 8c5ffcd9

Big science related changes (#1407)

jeffra committed 3 years ago

Verified e2fdd254

Bump nokogiri from 1.11.4 to 1.12.5 in /docs (#1409)

dependabot[bot] committed 3 years ago

Verified 39c77440

[CI] install fix for HF tests and use dict instead of json for some tests (#1405)

jeffra committed 3 years ago

Verified 9e5c0c5c

[CI] Add HF transformers tests (#958)

awan-10 committed 3 years ago

Verified c1829c45

Fix from Felipe and Young for loading checkpoints. (#1389)

awan-10 committed 3 years ago

Verified 86dd6a64

[zero_to_fp32] fix padding removal (#1380)

stas00 committed 3 years ago

Verified 364994ad

add tutorial on pytorch profiler usage (#1350)

cli99 committed 3 years ago

Verified 51a2e916

Sparse attn triton v1.0 support + torch1.8 test runner (#1374)

jeffra committed 3 years ago

Verified 6996bb01

fix: support three digit layer numbers (#1377)

adammoody committed 3 years ago

Verified 4ad8019c

jeffra committed 3 years ago

45a498d0

[zero_to_fp32] adapt to 4-bytes alignment in z2 (#1372)

stas00 committed 3 years ago

Verified 30537e71

[zero Init] fix regression (#1373)

stas00 committed 3 years ago

Verified cf22a691

Introduce a device rank when setting device (#1370)

Sean Naren committed 3 years ago

Verified 90398a70

jeffra committed 3 years ago

a708b187

Update setup.py (#1361)

anukaal committed 3 years ago

Verified 8e577c92

fix unit test failure when merging PP ckpt files (#1359)

eltonzheng committed 3 years ago

Verified 9b915fed

Remove dropout as client code can do it independently. (#1354)

awan-10 committed 3 years ago

Verified 9f5939d2

Correctness fix PP+ZeRO for gradient accumulation (#1264)

jeffra committed 3 years ago

Verified b712babe

Update website hiring link

jeffra committed 3 years ago

Verified bff6126f

Older