DeepSpeed
Update sharded_moe.py to support top2 gate with Tutel
#6948

Open

Update sharded_moe.py to support top2 gate with Tutel #6948

xenshinu wants to merge 4 commits into deepspeedai:master from xenshinu:patch-1

xenshinu requested a review from

tohtana 363 days ago

loadams requested a review from

hwchen2017 363 days ago

loadams commented on 2025-01-15

add tutel support for top2

fc153327

xenshinu force pushed from e856af5e to fc153327 336 days ago

xenshinu requested a review from

tjruwase 336 days ago

Merge branch 'master' into patch-1

898415c1

Merge branch 'master' into patch-1

945c6bb5

Merge branch 'master' into patch-1

67824184

Reviewers

loadams

tohtana

hwchen2017

tjruwase

Assignees

No one assigned

Labels

None yet

Milestone

No milestone