microsoft/DeepSpeed

Pull Requests Commits

Fix triton compatibility

hwchen2017 committed 16 days ago

073677e9

Fix review comment

hwchen2017 committed 31 days ago

a694894c

Remove triton requirement

hwchen2017 committed 31 days ago

5e3280cc

remove triton compatibility check for fp_quantizer

hwchen2017 committed 31 days ago

6d5bdccf

Deprecate unused DeepSpeed features (#8490)

sfc-gh-truwase committed 31 days ago

Verified 71d316d6

[muon] Reconcile the momentum dtype when a checkpoint is restored (#8433)

alanhuangyoo committed 32 days ago

Verified b726f4ed

Carry the affine scale on the replicated map, not the split (#8477)

Achyuthan-S committed 32 days ago

Verified bce0adf0

Fix ZeRO parameter alignment for grouped_mm (#8277)

fwerkor committed 32 days ago

Verified 080eb6b0

feat(rollout): add continuous batching generation prototype (#8368)

nathon-lee committed 32 days ago

Verified e5887a35

Fix universal checkpoint resume across AutoTP sizes (#8474)

0z5a committed 32 days ago

Verified e76a2805

Fix comms logger KeyError when log_name is omitted (#8267)

jinyouzhi committed 32 days ago

Verified bd6e9681

Describe universal checkpoint shards as affine maps (#8385)

Achyuthan-S committed 32 days ago

Verified 11909466

Split DeepCompile ZeRO-3 memory scheduler (#8233)

tohtana committed 33 days ago

Verified 38561463

[MPS] Update C++ Standard in CPUAdamBuilder (#8466)

jinyouzhi committed 33 days ago

Verified bb7ad0d8

Avoid collective token preparation for AutoEP DeepEP (#8423)

yh0903 committed 33 days ago

Verified 29d0abbc

Muon is silently disabled under ZeRO-3 when the model is built with zero.Init (#8438)

alanhuangyoo committed 33 days ago

Verified 0166cc87

[AutoEP]Fix optimizer and replaced MOE parameter mismatch (#8377)

pengdurice committed 33 days ago

Verified 5daeffeb

Filter --include against the real slots, not against itself (#8239)

vineethsaivs committed 33 days ago

Verified 3b1c14ac

Add an opt-in ZeRO-1/2 gradient norm fast path (#8331)

yh0903 committed 33 days ago

Verified f992dc24

Muon runs no Newton-Schulz at ZeRO stage 0, the default: run it (#8442)

alanhuangyoo committed 34 days ago

Verified cbd303eb

Stop the debug name maps from pinning the model they snapshot (#8356)

alanhuangyoo committed 35 days ago

Verified e9680c7d

Read rope_theta from rope_parameters in the Llama injection policy (#8341)

alanhuangyoo committed 35 days ago

Verified 6474bc55

[Workflow] run modal GPU workflows only from the merge queue (#8412)

delock committed 35 days ago

Verified 1e90aa9f

Split the modal CI budget into acquisition and test phases (#8404)

delock committed 36 days ago

Verified 666720b4

fix(lr_schedules): make --lr_range_test_staircase an opt-in flag (#8337)

Anai-Guo committed 36 days ago

Verified 8d4074cb

Fix AutoTP + deep compile collectives silently drop when AC is on (#8355)

pengdurice committed 36 days ago

Verified 92269f43

Reshape instead of view in TiledFusedLogitsLoss (#8362)

alanhuangyoo committed 36 days ago

Verified 71199367

op_builder: use C++20 for nvcc on CUDA 13+ (#8422)

bheu committed 36 days ago

Verified abf3dfa4

Preserve AutoEP score correction bias buffers (#8369)

poorpaper committed 38 days ago

Verified 32110a95

[Workflow] Raise modal CI timeouts to absorb slower sandbox provisioning (#8403)

delock committed 39 days ago

Verified 05daf059

Older