microsoft/DeepSpeed

Pull Requests Commits

Port `parallel_state.py` (`mpu`) from Megatron-Deepspeed

stas00 committed 359 days ago

Verified ee4a9295

Link AutoTP blog in the front page (#7167)

hwchen2017 committed 360 days ago

Verified e7e20e4a

[NFC] Typo fix in SP layer. (#7152)

c8ef committed 360 days ago

Verified 2b245a99

Add destroy to tests to free memory (#7160)

tohtana committed 361 days ago

Verified 9ae010e6

Avoid graph break by removing redundant requires_grad attr change (#7158)

deepcharm committed 361 days ago

Verified d40cf466

hf tp+zero training doc. (#7151)

inkcherry committed 364 days ago

Verified 1ca83a6b

fix leak of z3 buffer

Masahiro Tanaka committed 1 year ago

2e7f8e58

Update container version that runs on A6000 tests. (#7153)

loadams committed 1 year ago

Verified 3388f833

Enhance Gaudi2 CI/Nightly Coverage with Model Parallelism and Linear Tests (#7146)

raza-sikander committed 1 year ago

Verified 29e9fd53

Correct the BACKWARD_PREFETCH_SUBMIT mismatch (#7120)

A-transformer committed 1 year ago

Verified 64fcff05

Conditionally quote env vars (#7071)

saurabhkoshatwar committed 1 year ago

Verified 591d4d4d

Unpin transformers version for most workflows (#7139)

loadams committed 1 year ago

Verified d095b181

Add conditional expression (#7119)

A-transformer committed 1 year ago

Verified 39027c30

Avoid missing attr error (#7133)

tjruwase committed 1 year ago

Verified 9288bc4f

Update CONTRIBUTING.md to reflect changes from CLA to DCO (#7135)

loadams committed 1 year ago

Verified 7d9dbf28

Training multiple models (#7018)

tjruwase committed 1 year ago

Verified b418cf6c

Add sequential pytest mark to TestNVMeCheckpointing to resolve pytest forked hangs (#7131)

loadams committed 1 year ago

Verified 436c1262

fix keep_module_on_host (#7112)

inkcherry committed 1 year ago

Verified 8ec1af5f

Update gaudi2 nightly,ci to latest 1.20.0 build (#7093)

raza-sikander committed 1 year ago

Verified c1acd49c

Update references to new X/Twitter handle (#7110)

loadams committed 1 year ago

Verified c2c81993

Fix fused_qkv print model ValueError (#7109)

Yejing-Lai committed 1 year ago

Verified 71807bce

Avoid graph break due to unsupported frozenset (#7105)

deepcharm committed 1 year ago

Verified 17c65954

Only run pre-commit on the changes (#7106)

hwchen2017 committed 1 year ago

Verified e4c7931a

Avoid graph breaks in torch.compile caused by inner classes in the backward hooks (#7062)

deepcharm committed 1 year ago

Verified 776822fe

Avoid graph breaks by disabling sourceless calls in instrument_w_nvtx (#7081)

deepcharm committed 1 year ago

Verified a88f56a0

Use new dlpack api; Formatting fixes (#7101)

tjruwase committed 1 year ago

Verified b4177e45

Remove workflows for very old torch versions (#7090)

loadams committed 1 year ago

Verified 02bbf501

Update parallelism for nv-torch-latest/nightly tests due to more GPUs/runner (#7086)

loadams committed 1 year ago

Verified f2ed2531

Update README.md with ICS '23 MoE paper link (#7087)

siddharth9820 committed 1 year ago

Verified 5320d4c9

Pin transformers version on tests that use latest. (#7085)

loadams committed 1 year ago

Verified f8d34295

Older