microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into inference/fix-mp-init

RezaYazdaniAminabadi committed 3 years ago

Verified 7318d19c

Fix typo in assert message (#1420)

manuelciosici committed 3 years ago

Verified 56124621

Merge branch 'master' into inference/fix-mp-init

jeffra committed 3 years ago

Verified a4d4f964

[CI] make build names consistent

jeffra committed 3 years ago

Verified a4ffc831

[ci] hf dependencies (#1417)

stas00 committed 3 years ago

Verified 8c5ffcd9

Big science related changes (#1407)

jeffra committed 3 years ago

Verified e2fdd254

Bump nokogiri from 1.11.4 to 1.12.5 in /docs (#1409)

dependabot[bot] committed 3 years ago

Verified 39c77440

Save the model parallel group at inference engine statically

Reza Yazdani committed 3 years ago

492f8754

[CI] install fix for HF tests and use dict instead of json for some tests (#1405)

jeffra committed 3 years ago

Verified 9e5c0c5c

[CI] Add HF transformers tests (#958)

awan-10 committed 3 years ago

Verified c1829c45

Fix from Felipe and Young for loading checkpoints. (#1389)

awan-10 committed 3 years ago

Verified 86dd6a64

[zero_to_fp32] fix padding removal (#1380)

stas00 committed 3 years ago

Verified 364994ad

add tutorial on pytorch profiler usage (#1350)

cli99 committed 3 years ago

Verified 51a2e916

Sparse attn triton v1.0 support + torch1.8 test runner (#1374)

jeffra committed 3 years ago

Verified 6996bb01

fix: support three digit layer numbers (#1377)

adammoody committed 3 years ago

Verified 4ad8019c

jeffra committed 3 years ago

45a498d0

[zero_to_fp32] adapt to 4-bytes alignment in z2 (#1372)

stas00 committed 3 years ago

Verified 30537e71

[zero Init] fix regression (#1373)

stas00 committed 3 years ago

Verified cf22a691

Introduce a device rank when setting device (#1370)

Sean Naren committed 3 years ago

Verified 90398a70

jeffra committed 3 years ago

a708b187

Update setup.py (#1361)

anukaal committed 3 years ago

Verified 8e577c92

fix unit test failure when merging PP ckpt files (#1359)

eltonzheng committed 3 years ago

Verified 9b915fed

Remove dropout as client code can do it independently. (#1354)

awan-10 committed 3 years ago

Verified 9f5939d2

Correctness fix PP+ZeRO for gradient accumulation (#1264)

jeffra committed 3 years ago

Verified b712babe

Update website hiring link

jeffra committed 3 years ago

Verified bff6126f

update hiring link

jeffra committed 3 years ago

Verified 168fce30

Update matmul.py (#1349)

hyunwoongko committed 3 years ago

Verified eb97a424

Added 4-byte alignment on NCCL/RCCL (#1328)

amathews-amd committed 3 years ago

Verified 2c628439

[actions] revert unit-test build name

jeffra committed 3 years ago

Verified 3e7d06ad

[actions] add torch version runner label

jeffra committed 3 years ago

Verified 0a32c3e2

Older