DeepSpeed

72608904 - reduce cpu host overhead when using moe (#5578)

reduce cpu host overhead when using moe (#5578) The operation `.to('cpu') `is not necessary for exp_counts, and it will cause device to host synchronization which damage performance. Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>