DeepSpeed
MoE inference + PR-MoE model support
#1705
Merged
Overview
Commits
7
Changes
View On GitHub

MoE inference + PR-MoE model support #1705

jeffra merged 7 commits into master from staging-moe-next-v1
jeffra
yaozhewei non standard moe support (#273)
8b82cf21
jeffra Merge MoE-inference to Staging moe next (#282)
1477c02d
jeffra small fix for test_moe
b2b726e6
jeffra fixing moe ckpt unit test to align with new API
13911e63
jeffra bug fix for mp-ep group creation, includes TODO for later fix
ce9ff353
jeffra bump to v0.6.0
c899e6e3
jeffra simplify moe ckpt unit test
dab741a5
jeffra jeffra requested a review from awan-10 awan-10 4 years ago
jeffra jeffra requested a review from cli99 cli99 4 years ago
jeffra jeffra requested a review from conglongli conglongli 4 years ago
jeffra jeffra requested a review from eltonzheng eltonzheng 4 years ago
jeffra jeffra requested a review from minjiaz minjiaz 4 years ago
jeffra jeffra requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 4 years ago
jeffra jeffra requested a review from samyam samyam 4 years ago
jeffra jeffra requested a review from ShadenSmith ShadenSmith 4 years ago
jeffra jeffra requested a review from tjruwase tjruwase 4 years ago
awan-10
awan-10 approved these changes on 2022-01-19
jeffra jeffra merged e46d808a into master 4 years ago
jeffra jeffra deleted the staging-moe-next-v1 branch 4 years ago
lekurile lekurile restored the head branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum