microsoft/DeepSpeed

Pull Requests Commits

add overflow check

GuanhuaWang committed 1 year ago

fe0f6319

compute global norm on device (#5125)

BacharL committed 1 year ago

Verified 9f0e2136

Update container version for Gaudi2 CI (#5360)

raza-sikander committed 1 year ago

Verified 548d37b1

[fix] fix typo s/simultanenously /simultaneously (#5359)

digger-yu committed 1 year ago

Verified d86a68c3

Add `distributed_port` for `deepspeed.initialize` (#5260)

LZHgrla committed 1 year ago

Verified dc3554f8

Fix sort of zero checkpoint files (#5342)

tohtana committed 1 year ago

Verified c946a342

BF16 optimizer: Clear lp grads after updating hp grads in hook (#5328)

YangQun1 committed 1 year ago

Verified 40009eb1

resolve KeyError: 'PDSH_SSH_ARGS_APPEND' (#5318)

Lzhang-hub committed 1 year ago

Verified cc897ecf

Make NFS warning print only once (#5345)

HeyangQin committed 1 year ago

Verified b5e2045c

Revert "Rename test group from amd-test to unit-tests to make rrequired when enabled and running on PRs"

loadams committed 1 year ago

1bc15efe

Rename test group from amd-test to unit-tests to make rrequired when enabled and running on PRs

loadams committed 1 year ago

378440d9

Correct typo in checking on bf16 unit test support (#5317)

loadams committed 1 year ago

Verified 014576a8

Add NFS path check for default deepspeed triton cache directory (#5323)

HeyangQin committed 1 year ago

Verified ffb53c25

Increase coverage for HPU (#5324)

loadams committed 1 year ago

Verified 4c51dce8

Improve universal checkpoint (#5289)

tohtana committed 1 year ago

Verified c56a4b9e

Added Gaudi2 CI tests. (#5275)

vshekhawat-hlab committed 1 year ago

Verified 330d36bb

Docs typos fix and grammar suggestions (#5322)

Gr0g0 committed 1 year ago

Verified cea5ea1e

Modified regular expression (#5306)

igeni committed 1 year ago

Verified a32789b0

fix comms dtype (#5297)

mayank31398 committed 1 year ago

Verified ed8aed57

Enable mixtral 8x7b autotp (#5257)

Yejing-Lai committed 1 year ago

Verified 8d98e171

support bf16_optimizer moe expert parallel training and moe EP grad_scale/grad_norm fix (#5259)

inkcherry committed 1 year ago

Verified e5dd5501

Fixed Accelerate Link (#5314)

wkaisertexas committed 1 year ago

Verified 4520edd6

Add intel gaudi to contributed HW in README (#5300)

BacharL committed 1 year ago

Verified 0529eac6

Add Habana Gaudi2 CI badge to the README (#5286)

loadams committed 1 year ago

Verified 3dd3d514

Fix loading a universal checkpoint (#5263)

tohtana committed 1 year ago

Verified b112c99e

Add HPU accelerator support in unit tests. (#5162)

vshekhawat-hlab committed 1 year ago

Verified 2df8e234

Average only valid part of the ipg buffer. (#5268)

BacharL committed 1 year ago

Verified 75e579e7

Added HPU backend support for torch.compile tests. (#5269)

vshekhawat-hlab committed 1 year ago

Verified a6fb4d3e

Enabled LMCorrectness inference tests on HPU. (#5271)

vshekhawat-hlab committed 1 year ago

Verified cf58c535

Skip 1Bit Compression and sparsegrad tests for HPU. (#5270)

vshekhawat-hlab committed 1 year ago

Verified d2ef20e7

Older