deepspeedai/DeepSpeed

Pull Requests Commits

Clamp capacity to num_tokens in MoE gating drop branches (complete #5353) (#8155)

ebarkhordar committed 58 days ago

Verified c43cf21c

Skip CUDA transformer forward tests when TransformerBuilder is incompatible (#8200)

sfc-gh-truwase committed 59 days ago

Verified 7e07be2a

Enable ZeRO-3 linear wrapper for existing models (#8189)

tohtana committed 59 days ago

Verified 617061d6

Release GIL in blocking AIO bindings (#8196)

tohtana committed 59 days ago

Verified e2aae1b0

Warn when zero.Init silently falls back to a single rank (#8084) (#8089)

akshansh47 committed 59 days ago

Verified a375b7f1

Derive AutoEP rank splits from the per-expert count exchange (#8190)

yh0903 committed 60 days ago

Verified 35d1c7d3

[AutoTP] Preserve universal checkpoint metadata for HuggingFace tp_plan (#8187)

jinyouzhi committed 60 days ago

Verified d6fbd476

Clarify merge commit exemption for signoff check in AGENTS.md and CLAUDE.md (#8194)

jinyouzhi committed 60 days ago

Verified 5cc06170

Scope DeepCompile compiler state to graph and engine lifecycles (#8159)

tohtana committed 61 days ago

Verified 615e6d5e

[AutoTP] Enable HF `colwise_gather_output` to support `lm_head` replace (#8146)

jinyouzhi committed 61 days ago

Verified 48d54e05

Make the OneCycle stair counts actually change the schedule (#8179)

vineethsaivs committed 61 days ago

Verified 3169c2dc

Fix WarmupLR collapsing multi-group base LRs to group 0's (#8171)

ebarkhordar committed 61 days ago

Verified 6c58fb75

Guard LRRangeTest and OneCycle schedulers against zero step sizes (#8166)

ebarkhordar committed 61 days ago

Verified 90e30f4d

Stabilize fork-sensitive nightly tests and AutoSP coverage (#8172)

tohtana committed 61 days ago

Verified 86fd223f

NVMe write warning (#8164)

sfc-gh-truwase committed 64 days ago

Verified 010c6e91

Enable support for Tutel when k != 1 for shared moe (#8174)

jinyouzhi committed 64 days ago

Verified dc81c9ee

Fix autotuning get_val_by_key to search all nested subdicts (#8177)

ebarkhordar committed 64 days ago

Verified 4b693658

[AutoTP] Allow ZeRO stage 3 inference with tensor parallelism (#8167)

delock committed 65 days ago

Verified d3265209

Run pull request code only inside a Modal Sandbox (#8170)

tohtana committed 66 days ago

Verified 39adc2b1

Validate warmup_type in WarmupCosineLR like WarmupLR (#8151)

sohumt123 committed 68 days ago

Verified 886790b5

Adopt PTF Code of Conduct (#8165)

sfc-gh-truwase committed 68 days ago

Verified 0c36f6d3

Z3: Support for activation ckpt with frozen params (#8148)

sfc-gh-truwase committed 68 days ago

Verified a31eb316

Fix repeated gradient scaling across pipeline stages (#8154)

Functionhx committed 70 days ago

Verified d99a6429

Fix ZeRO-3 hooks for attribute-delegating modules (#8144)

Functionhx committed 70 days ago

Verified 75f395fd

Update Zhipeng Wang affiliation to Google in COMMITTERS.md (#8153)

PKUWZP committed 72 days ago

Verified 4c275f9e

Update CI badge (#8150)

tohtana committed 73 days ago

Verified ec8411e6

Use synthetic CIFAR data in AlexNet tests (#8143)

tohtana committed 73 days ago

Verified b81c6eb3

Fix DeepCompile fallback handling for scalar outputs (#8149)

tohtana committed 73 days ago

Verified 397efe87

[DeepCompile] Add lightweight pass contracts for optimization passes (#8139)

jahnavi-yelamanchi committed 73 days ago

Verified b048a7dc

fix(muon): support ZeRO-1/2 reduce scatter (#8141)

Micuks committed 73 days ago

Verified de1846cf

Newer Older