microsoft/DeepSpeed

Pull Requests Commits

docs: item 2 closed — in-place kernel regression confirmed, copy-back structural

delock committed 6 days ago

2216879b

Revert "test(tp): retry the in-place recurrent at TP (loop 4 re-examination)"

delock committed 6 days ago

ddf81f7b

test(tp): retry the in-place recurrent at TP (loop 4 re-examination)

delock committed 6 days ago

62238994

docs: item 1 kept — +3.6-4.0% (concat cuBLAS + silu_mul GLU)

delock committed 6 days ago

ce11b813

perf(kernels): Ampere GLU routes to concat-cached cuBLAS + native silu_mul

delock committed 6 days ago

b2935b17

docs: fresh A100 host a+b — results reproduce, custom AR re-confirmed

delock committed 6 days ago

1274c54f

docs: A40 host NCCL broken at transport setup; custom-AR PCIe attribution corrected

delock committed 7 days ago

f3731d32

fix: PCIe-sized handshake spin bound (volatile reads ~100ns each)

delock committed 7 days ago

ef6d761e

fix(comm): bounded handshake gates the custom AR — PCIe P2P hangs fall back

delock committed 7 days ago

88b4d506

Merge master into gma/qwen_ki_expr

delock committed 7 days ago

bdb6395d

fix(rollout): narrow the padded-prompt fallback to configs that need it

delock committed 7 days ago

539598ba

docs: phoeenniixx review verified on A40 — guard regression confirmed, fix direction validated

delock committed 7 days ago

493e2d9e

Check where column-split pieces write in a shard (#8922)

Achyuthan-S committed 7 days ago

Verified 8d4f29c7

Fix race between folded checkpoint load and metadata drop in AutoEP+AutoTP test (#8943)

jinyouzhi committed 7 days ago

Verified 1bdaaf73

[AutoEP] Ensure consistent order of partition groups in all-gather when ZeRO-3 (#8876)

jinyouzhi committed 7 days ago

Verified 12ffb990

docs: route C v1 — repeat_qk wash; glue long-tail economics recorded

delock committed 7 days ago

349e7308

fix: bind torch.library ops at install regardless of the compile flag

delock committed 7 days ago

bac8c19b

perf(kernels): native repeat_qk — one launch for the q/k head-repeat (route C glue)

delock committed 7 days ago

eb5bff48

docs: route A v1 — registration proven, whole-forward compile regresses (graph break at cache objects); v2 = pure-tensor segment extraction

delock committed 7 days ago

29d98259

fix: dynamic shapes for the compiled GDN forward

delock committed 7 days ago

f5c47b6e

fix: gdn_gates fake mirrors input shapes

delock committed 7 days ago

d6efc320

fix: single-element mutates_args tuples need trailing commas

delock committed 7 days ago

76147d02

feat(segki): torch.library op registration + opt-in compile of GDN forward (route A)

delock committed 7 days ago

198245d6

docs: custom P2P inference AR — +7-10% E2E, bitwise-identical, hook route proven

delock committed 7 days ago

70716e2d

fix: propagate the custom-AR result out of a contiguous() copy

delock committed 7 days ago

4489129f

fix: custom-AR latency path also serves no-grad decode of training engines

delock committed 7 days ago

dac60fad

fix: car_create_buffers returns py::bytes (signature, not just literal)

delock committed 7 days ago

43c95e81

fix: return the handle as py::bytes (binary-safe)

delock committed 7 days ago

a5ceef2c

fix: match pure-IPC extension API in the python glue

delock committed 7 days ago

4b2aa689

fix: use the 64-byte raw handle field (66B one is torch's wrapper)

delock committed 7 days ago

f6f9022e

Older