DeepSpeed
Add fp16 support of Qwen1.5MoE models (A2.7B) to DeepSpeed-FastGen
#5403

Merged

Add fp16 support of Qwen1.5MoE models (A2.7B) to DeepSpeed-FastGen #5403

loadams merged 6 commits into deepspeedai:master from ZonePG:master

ZonePG requested a review from

mrwyattii 1 year ago

ZonePG requested a review from

awan-10 1 year ago

ZonePG requested a review from

arashb 1 year ago

Add fp16 support of Qwen1.5MoE models (A2.7B) to DeepSpeed-FastGen

2ead98b2

ZonePG force pushed from b458df5b to 2ead98b2 1 year ago

ZonePG commented on 2024-04-12

adk9 requested a review from

adk9 1 year ago

Merge branch 'microsoft:master' into master

27b66b08

HeyangQin approved these changes on 2024-07-15

HeyangQin enabled auto-merge 1 year ago

Merge branch 'master' into master

67646f60

Merge branch 'master' into master

a89fceb8

disabled auto-merge 1 year ago
Manually disabled by user

loadams removed review request from

mrwyattii 1 year ago

loadams requested a review from

lekurile 1 year ago

Merge branch 'master' into master

b8929ca4

lekurile approved these changes on 2024-07-16

Merge branch 'master' into master

71838c3a

adk9 approved these changes on 2024-08-01

loadams merged 249c1db2 into master 1 year ago

Reviewers

adk9

lekurile

HeyangQin

awan-10

arashb

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Add fp16 support of Qwen1.5MoE models (A2.7B) to DeepSpeed-FastGen #5403 Merged

Add fp16 support of Qwen1.5MoE models (A2.7B) to DeepSpeed-FastGen #5403

DeepSpeed
Add fp16 support of Qwen1.5MoE models (A2.7B) to DeepSpeed-FastGen
#5403

Merged