DeepSpeed
2390bc5c - Fix DeepCompile for PyTorch 2.8/2.9 compatibility (#7755)

Commit
70 days ago
Fix DeepCompile for PyTorch 2.8/2.9 compatibility (#7755) PyTorch 2.8 added a new static_lifetime_input_indices parameter to the partition function. This breaks DeepCompile with ZeRO stage 3. This PR updates `partition_recompute_ds_params` to accept `**kwargs` and forward them to the underlying partition function, maintaining backward compatibility with PyTorch 2.6/2.7. DeepCompile works with PyTorch v2.9 when using ZeRO Stage 1 or 2. However, ZeRO Stage 3 is not currently supported on PyTorch v2.9 (it still works on PyTorch <= v2.8). DeepCompile tests are skipped when PyTorch version is v2.9 and ZeRO stage is 3. --------- Signed-off-by: Masahiro Tanaka <mtanaka@anyscale.com>
Author
Parents
Loading