microsoft/DeepSpeed

Pull Requests Commits

Address review feedback for Muon ZeRO Stage 3 support

PKUWZP committed 106 days ago

da9b7738

Extending Muon Optimizer Support for ZeRO Stage 3

PKUWZP committed 108 days ago

56451ea0

Update version (#7903)

loadams committed 118 days ago

Verified 5f7b6870

fix(zero3): use current_stream() instead of default_stream() for grad… (#7898)

michaelroyzen committed 118 days ago

Verified be60451f

Add AGENTS.md and CLAUDE.md with project rules for AI coding agents (#7902)

delock committed 118 days ago

Verified 49a82a0d

fix: Validate fp16.loss_scale is finite and non-negative (#7889)

nathon-lee committed 119 days ago

Verified 63eeb114

Fix Evoformer's multi-arch dispatch root cause (#7881)

tohtana committed 119 days ago

Verified 784cc26e

Fix async_io ops building error on Huawei Ascend NPU (#7894)

huangyifan0610 committed 119 days ago

Verified f88d0f8d

double reduction user-friendly error (#7895)

stas00 committed 121 days ago

Verified b6346bf0

[Bloom] Fix hangs of bloom test (#7890)

k-artem committed 122 days ago

Verified d9a4aadb

Suppress see_memory_usage logs (#7891)

sfc-gh-truwase committed 123 days ago

Verified 285cae30

Fix hook count performance regression from v0.18.5 (#7886)

tohtana committed 126 days ago

Verified 6c59d544

Add document section explaining autocast nesting (#7883)

tohtana committed 127 days ago

Verified 4dba1e20

Remove amp() from abstract accelerator (#7879)

delock committed 129 days ago

Verified a41a96b1

XPU use stock pytorch instead of Intel Extension for PyTorch (#7877)

delock committed 129 days ago

Verified d8e15da4

Fix import deepspeed crash on PyTorch v2.3 + Python 3.12 (#7875)

tohtana committed 130 days ago

Verified 04d69cc6

Fix no-grad grad-fn lookup in ZeRO hook counting on PyTorch 2.3 (#7830) (#7841)

tohtana committed 130 days ago

Verified bffaf457

Fix: only add parameter with grads to parameter group (#7869)

delock committed 130 days ago

Verified 116dbe28

perf: use deque for FIFO queues in sequence parallel, superoffload, and compile (#7880)

giulio-leone committed 130 days ago

Verified a15e557d

fix: replace 35 bare except clauses with except Exception (#7873)

haosenwang1018 committed 133 days ago

Verified ae21699a

Fix broken links and add AutoTP Training tutorial to sidebar nav (#7874)

tohtana committed 134 days ago

Verified efc0b49a

Schedule nightly full test (#7870)

tohtana committed 135 days ago

Verified 0416cf68

Fix Zero-3 static scale assertion in fp16 test (#7866)

tohtana committed 137 days ago

Verified 93524c89

Throw error when parameter is modified in GatheredParameters (#7832)

tohtana committed 138 days ago

Verified 57b10d54

Fix compilation of Evoformer (#7862)

Flamefire committed 138 days ago

Verified c9e652cf

Fix ROCm BF16 conversion intrinsics in inference v2 (#7843) (#7846)

tohtana committed 141 days ago

Verified dbc1b075

Add EXAONE 4.0 model support for Inference V2 (#7853)

Bias92 committed 142 days ago

Verified f3a9819c

Add news entry for DeepSpeed updates (#7854)

PKUWZP committed 143 days ago

Verified 8a63a2a9

Enable shm_comm support for arm (#7800)

phalani-paladugu committed 144 days ago

Verified 7f49367a

Z1/2 init: flatten params on device (#7828)

ksugama committed 146 days ago

Verified 84af8221

Older