deepspeedai/DeepSpeed

Pull Requests Commits

Merge branch 'master' into sfc-gh-truwase/gas_mgmt_zero01

sfc-gh-truwase committed 7 hours ago

Verified 77fbb461

Skip CUDA transformer forward tests when TransformerBuilder is incompatible (#8200)

sfc-gh-truwase committed 20 hours ago

Verified 7e07be2a

Track global_samples by actual micro-batch count in unmanaged mode

sfc-gh-truwase committed 20 hours ago

43070642

Enable ZeRO-3 linear wrapper for existing models (#8189)

tohtana committed 22 hours ago

Verified 617061d6

Reject ZeRO overlap_comm in unmanaged gradient accumulation

sfc-gh-truwase committed 1 day ago

6b3d3564

Release GIL in blocking AIO bindings (#8196)

tohtana committed 1 day ago

Verified e2aae1b0

Warn when zero.Init silently falls back to a single rank (#8084) (#8089)

akshansh47 committed 1 day ago

Verified a375b7f1

Derive AutoEP rank splits from the per-expert count exchange (#8190)

yh0903 committed 1 day ago

Verified 35d1c7d3

Tersify comments in unmanaged gradient accumulation tests

sfc-gh-truwase committed 2 days ago

0191153d

Address tohtana review: reject set_gradient_accumulation_boundary/offload in unmanaged mode, fix test micro-batch accounting

sfc-gh-truwase committed 2 days ago

bee8ed56

Docs: make loss averaging explicit in unmanaged accumulation example

sfc-gh-truwase committed 2 days ago

ab6e8ac7

[AutoTP] Preserve universal checkpoint metadata for HuggingFace tp_plan (#8187)

jinyouzhi committed 2 days ago

Verified d6fbd476

Clarify merge commit exemption for signoff check in AGENTS.md and CLAUDE.md (#8194)

jinyouzhi committed 2 days ago

Verified 5cc06170

Scope DeepCompile compiler state to graph and engine lifecycles (#8159)

tohtana committed 2 days ago

Verified 615e6d5e

[AutoTP] Enable HF `colwise_gather_output` to support `lm_head` replace (#8146)

jinyouzhi committed 3 days ago

Verified 48d54e05

Make the OneCycle stair counts actually change the schedule (#8179)

vineethsaivs committed 3 days ago

Verified 3169c2dc

Fix WarmupLR collapsing multi-group base LRs to group 0's (#8171)

ebarkhordar committed 3 days ago

Verified 6c58fb75

Guard LRRangeTest and OneCycle schedulers against zero step sizes (#8166)

ebarkhordar committed 3 days ago

Verified 90e30f4d

Stabilize fork-sensitive nightly tests and AutoSP coverage (#8172)

tohtana committed 3 days ago

Verified 86fd223f

Docs: make unmanaged gradient accumulation example use scale_wrt_gas=False

sfc-gh-truwase committed 3 days ago

dec2b145

Docs: mark unmanaged ZeRO-2/3 and offload as not yet available

sfc-gh-truwase committed 4 days ago

c6ba3415

Merge branch 'master' into sfc-gh-truwase/gas_mgmt_zero01

sfc-gh-truwase committed 4 days ago

Verified 4c6ae671

sfc-gh-truwase committed 4 days ago

dbe79089

Guard unmanaged gradient accumulation against unsupported features

sfc-gh-truwase committed 4 days ago

e7592ea5

NVMe write warning (#8164)

sfc-gh-truwase committed 5 days ago

Verified 010c6e91

Enable support for Tutel when k != 1 for shared moe (#8174)

jinyouzhi committed 5 days ago

Verified dc81c9ee

Fix autotuning get_val_by_key to search all nested subdicts (#8177)

ebarkhordar committed 5 days ago

Verified 4b693658

Add managed_gradient_accumulation for ZeRO stage 0/1

sfc-gh-truwase committed 7 days ago

00800f7a

[AutoTP] Allow ZeRO stage 3 inference with tensor parallelism (#8167)

delock committed 7 days ago

Verified d3265209

Run pull request code only inside a Modal Sandbox (#8170)

tohtana committed 8 days ago

Verified 39adc2b1

Older