DeepSpeed
reduce cpu host overhead when using moe
#5578
Merged

reduce cpu host overhead when using moe #5578

tohtana merged 3 commits into deepspeedai:master from zhejiang/reduce_host_overhead_moe
ranzhejiang
ranzhejiang ranzhejiang requested a review from awan-10 awan-10 1 year ago
loadams loadams requested a review from tohtana tohtana 1 year ago
tohtana
tohtana commented on 2024-05-31
tohtana
tohtana commented on 2024-05-31
ranzhejiang
ranzhejiang reduce cpu host overhead when using moe
1cb0efdd
ranzhejiang
tjruwase Merge branch 'master' into zhejiang/reduce_host_overhead_moe
60d9de21
tjruwase Merge branch 'master' into zhejiang/reduce_host_overhead_moe
a0669d9a
tohtana
tohtana approved these changes on 2024-08-21
tohtana tohtana merged 72608904 into master 1 year ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone