DeepSpeed

d3265209 - [AutoTP] Allow ZeRO stage 3 inference with tensor parallelism (#8167)

[AutoTP] Allow ZeRO stage 3 inference with tensor parallelism (#8167) Replace the unconditional zero_optimization_stage() <= 2 assert in _configure_tensor_parallel_states with a guard that only blocks AutoTP + ZeRO-3 when an optimizer is present. The ZeRO-Inference path (no optimizer → DummyOptim → DeepSpeedZeRoOffload) is now permitted; the training path (optimizer → DeepSpeedZeroOptimizer_Stage3) raises NotImplementedError. AutoTP with ZeRO-3 checkpoint saving should be tracked seperatly in a seperate PR. --------- Signed-off-by: Guokai Ma <guokai.ma@intel.com>