DeepSpeed
Add fp16 support of Qwen1.5 models (0.5B to 72B) to DeepSpeed-FastGen
#5219

Merged

Add fp16 support of Qwen1.5 models (0.5B to 72B) to DeepSpeed-FastGen #5219

mrwyattii merged 2 commits into deepspeedai:master from ZonePG:master

ZonePG requested a review from

mrwyattii 1 year ago

ZonePG requested a review from

awan-10 1 year ago

ZonePG requested a review from

arashb 1 year ago

Add fp16 support of Qwen1.5 models (0.5B to 72B) to DeepSpeed-FastGen

388fee35

ZonePG force pushed from 68206d8f to 388fee35 1 year ago

mrwyattii approved these changes on 2024-03-02

Merge branch 'master' into master

7f6f0636

mrwyattii merged bcc617a0 into master 1 year ago

Reviewers

mrwyattii

awan-10

arashb

Assignees

No one assigned

Labels

None yet

Milestone

No milestone