microsoft/DeepSpeed

Pull Requests Commits

Keep invalid group-norm sentinels from becoming a finite 1.0 step

sfc-gh-truwase committed 4 hours ago

e051e863

Honor --include/--exclude in the SLURM launcher (#8304)

vineethsaivs committed 9 days ago

Verified 8bdd8f19

Offload a saved view when it is the last value holding its storage (#8388)

pengdurice committed 9 days ago

Verified 56631282

Fix sequence overlap backward gradient permutation (#8342)

taking-lying-flat committed 9 days ago

Verified 2ce20d6a

Validate positive inference and HybridEngine max output tokens (#8343)

taking-lying-flat committed 9 days ago

Verified 7c1b0f2c

[Phase 2] Add NEON SIMD path for CPU Adam on AArch64 (#8453)

PKUWZP committed 9 days ago

Verified c102bbd1

Muon silently discards the param groups it is given (#8440)

alanhuangyoo committed 9 days ago

Verified 113c6752

Remove triton compatibility check for fp_quantizer (#8492)

hwchen2017 committed 9 days ago

Verified cc05b811

[muon] Keep the momentum out of steps the loss scaler discards (#8435)

alanhuangyoo committed 10 days ago

Verified b5e000c4

Deprecate unused DeepSpeed features (#8490)

sfc-gh-truwase committed 11 days ago

Verified 71d316d6

[muon] Reconcile the momentum dtype when a checkpoint is restored (#8433)

alanhuangyoo committed 12 days ago

Verified b726f4ed

Carry the affine scale on the replicated map, not the split (#8477)

Achyuthan-S committed 12 days ago

Verified bce0adf0

Fix ZeRO parameter alignment for grouped_mm (#8277)

fwerkor committed 12 days ago

Verified 080eb6b0

feat(rollout): add continuous batching generation prototype (#8368)

nathon-lee committed 12 days ago

Verified e5887a35

Fix universal checkpoint resume across AutoTP sizes (#8474)

0z5a committed 12 days ago

Verified e76a2805

Fix comms logger KeyError when log_name is omitted (#8267)

jinyouzhi committed 12 days ago

Verified bd6e9681

Describe universal checkpoint shards as affine maps (#8385)

Achyuthan-S committed 13 days ago

Verified 11909466

Split DeepCompile ZeRO-3 memory scheduler (#8233)

tohtana committed 13 days ago

Verified 38561463

[MPS] Update C++ Standard in CPUAdamBuilder (#8466)

jinyouzhi committed 13 days ago

Verified bb7ad0d8

Avoid collective token preparation for AutoEP DeepEP (#8423)

yh0903 committed 13 days ago

Verified 29d0abbc

Muon is silently disabled under ZeRO-3 when the model is built with zero.Init (#8438)

alanhuangyoo committed 13 days ago

Verified 0166cc87

[AutoEP]Fix optimizer and replaced MOE parameter mismatch (#8377)

pengdurice committed 13 days ago

Verified 5daeffeb

Filter --include against the real slots, not against itself (#8239)

vineethsaivs committed 13 days ago

Verified 3b1c14ac

Add an opt-in ZeRO-1/2 gradient norm fast path (#8331)

yh0903 committed 13 days ago

Verified f992dc24

Muon runs no Newton-Schulz at ZeRO stage 0, the default: run it (#8442)

alanhuangyoo committed 14 days ago

Verified cbd303eb

Stop the debug name maps from pinning the model they snapshot (#8356)

alanhuangyoo committed 15 days ago

Verified e9680c7d

Read rope_theta from rope_parameters in the Llama injection policy (#8341)

alanhuangyoo committed 15 days ago

Verified 6474bc55

[Workflow] run modal GPU workflows only from the merge queue (#8412)

delock committed 15 days ago

Verified 1e90aa9f

Split the modal CI budget into acquisition and test phases (#8404)

delock committed 16 days ago

Verified 666720b4

fix(lr_schedules): make --lr_range_test_staircase an opt-in flag (#8337)

Anai-Guo committed 16 days ago

Verified 8d4074cb

Older