DeepSpeed
24402c3b - NCCL and other backend PG timeout 30min -> 10min (#8253)

Commit
8 days ago
NCCL and other backend PG timeout 30min -> 10min (#8253) Apparently nccl/pytorch switched to a 10min collective timeout (from the original 30min) in 2024 (torch==2.2) but ds is at 30min still - should we sync with the more realistic timeout? 30min is a way too long, no collective takes more than 10min these days This change applies to all backends, even though pytorch changed the default for nccl only - since it's a sensible modern upgrade.
Author
Parents
Loading