DeepSpeed
f0001ab9 - Merge master: adopt the #8997 evolution of the custom-AR files

Commit
4 days ago
Merge master: adopt the #8997 evolution of the custom-AR files All five conflicting files resolved to master's version -- it carries our shm world-group guard (cherry-picked via #8997) plus the review hardening (single-group contract in custom_collective, group-aware readiness, settled() latch, rank-distinct test payloads) and the proper routing fix for the custom-Function grad probe (ctx.needs_input_grad instead of the always-False torch.is_grad_enabled()). This branch had no unique content in these files. Validated locally (CPU): unit/comm/test_custom_collective.py 5 passed / 2 skipped; TestTpGradNorm 4 passed / 2 skipped; tp_plan basic_training passed. Signed-off-by: Ma, Guokai <guokai.ma@gmail.com>
Author
Loading