DeepSpeed
Further refactor deepspeed.moe.utils + deepspeed.moe.layer type hints
#5060
Merged
Merged