microsoft/DeepSpeed

Pull Requests Commits

ci: align minimal NCCL diagnostic inputs

tohtana committed 10 days ago

Verified 2d333de5

ci: add minimal Modal NCCL diagnostic

tohtana committed 10 days ago

Verified 4900d462

ci: trace device ordinals in focused Modal test

tohtana committed 10 days ago

Verified 9080b0a7

ci: stop focused Modal diagnosis on first failure

tohtana committed 10 days ago

Verified 85cf9265

ci: run focused Modal comparison with one worker

tohtana committed 10 days ago

Verified ce1122cf

ci: restore Modal parity for focused test selection

tohtana committed 10 days ago

Verified 080d13c5

ci: install diagnostic source pins separately

tohtana committed 10 days ago

Verified 7f72d8b3

ci: allow pinned prerelease diagnostics

tohtana committed 10 days ago

Verified 8685331c

ci: add bounded Modal distributed reproducer

tohtana committed 10 days ago

Verified 6838418f

Merge branch 'master' into yh0903/bf16-release-lp-grads

tohtana committed 11 days ago

Verified 34704e11

feat(rollout): align decode fronts and trim dead zones (#8497)

nathon-lee committed 12 days ago

Verified a77aeb67

Add an opt-in fused Triton RoPE for Hugging Face split-half models (#8663)

yh0903 committed 12 days ago

Verified 583fc9c3

Merge branch 'master' into yh0903/bf16-release-lp-grads

tohtana committed 12 days ago

Verified ede9a9f2

Give rollout cache fakes the per-layer config Transformers now reads (#8730)

sfc-gh-truwase committed 13 days ago

Verified 8fb2c9a2

Harden ZeRO-1/2 offload gradient storage lifetime and stream ordering (#8632)

jeffra committed 14 days ago

Verified c687df79

Fix Ulysses SP registration for string model paths and gloo collectives (#8702)

delock committed 14 days ago

Verified 04e0be2b

AutoEP: reorder expert rows with gathers on the collective path (#8671)

yh0903 committed 14 days ago

Verified bfd29175

AutoEP: MiniMax-M3 preset (#8651)

pengdurice committed 14 days ago

Verified b9ce5f42

Add opt-in fused AutoEP DeepEP row weighting (#8644)

yh0903 committed 14 days ago

Verified 2c4ead4b

Add Fengchun Hua (hipudding) to COMMITTERS.md (#8718)

PKUWZP committed 14 days ago

Verified b879589a

Fix BF16 owned-fragment gradient reconstruction on current master

yh0903 committed 16 days ago

bd52453e

Keep Muon's update at full size under fp16 loss scaling (#8655)

alanhuangyoo committed 16 days ago

Verified 3509874e

Merge upstream master for BF16 gradient lifecycle review

yh0903 committed 16 days ago

f1a000c4

Nightly full-suite run with classified failure triage (#8606)

delock committed 16 days ago

Verified 865fde4f

AutoEP: one program per token in the fused weighted restore forward (#8678)

yh0903 committed 16 days ago

Verified 11b24d21

Restore a shard from the map the layer published (#8622)

Achyuthan-S committed 16 days ago

Verified a80df94b

Use expert gradients, not expert weights, in the FP16_Optimizer MoE grad norm (#8635)

yh0903 committed 17 days ago

Verified 1b60c549

Validate the AutoSP SP/DP mesh when registering process groups (#8674)

jinyouzhi committed 17 days ago

Verified 084e5f6e

Check AutoSP sequence length and head count divisibility (#8675)

jinyouzhi committed 17 days ago

Verified 245c3a98

Fix FPDT K/V gradient buffers under grouped-query attention (#8665)

jinyouzhi committed 17 days ago

Verified ece19cfe

Older