feat(comm): one-shot P2P custom all-reduce for TP=2 inference #8997
feat(comm): one-shot P2P custom all-reduce for TP=2 inference
d9054634
Remove reduce-scatter+all-gather fallback from RowParallel inference …
5b67adb1
Guard RowParallel all-reduce against non-contiguous inputs
735e6a56
Let inference_all_reduce own backend selection in RowParallel
817612e2
delock
marked this pull request as draft 15 days ago
Restore VocabParallelLinear fused_loss_capture override
e1f96180
delock
force pushed
from
ae7a5636
to
8f756c95
15 days ago
Restructure custom collective as an accelerator backend contract
9b2d0ecc
delock
force pushed
from
8f756c95
to
9b2d0ecc
15 days ago
delock
marked this pull request as ready for review 15 days ago
Drop top-level torch import from the custom_collective builder
9ec7d953
delock
force pushed
from
4d02ca7a
to
9ec7d953
15 days ago
Address review findings on the custom collective fast path
fe8a15f3
Add two-device parity test for the custom collective fast path
6413ab6c
Keep the custom collective route off the CPU accelerator for now
a2fb1038
Make the custom collective link setup safe and correct on real fabrics
aa6e8f15
clang-format the custom collective kernel
1cfdbed3
fix(comm): restrict the CPU shm inference all-reduce to world-wide gr…
4738e29a
Merge branch 'master' into gma/custom_ar_standalone
a1ed4d5d
Merge branch 'master' into gma/custom_ar_standalone
b24f6757
delock
force pushed
from
f86be4e2
to
50219aa3
4 days ago
delock
force pushed
from
50219aa3
to
c80239cc
4 days ago
delock
force pushed
from
c80239cc
to
d5f950c1
4 days ago
delock
force pushed
from
d5f950c1
to
2b0a1782
4 days ago
Address the review findings on link setup, routing, and tests
27f6d793
delock
force pushed
from
2b0a1782
to
27f6d793
4 days ago
delock
merged
7d30f920
into master 4 days ago
delock
deleted the gma/custom_ar_standalone branch 4 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub