DeepSpeed

reduce all-to-all communication volume when both expert and non-expert are tensor-parallel

#5626

Merged