DeepSpeed
fix fp16 Qwen2 series model to DeepSpeed-FastGen
#6028

Merged

fix fp16 Qwen2 series model to DeepSpeed-FastGen #6028

tohtana merged 2 commits into deepspeedai:master from ZonePG:master

fix Qwen2 serial model to DeepSpeed-FastGen

a9b82bc8

ZonePG requested a review from

awan-10 1 year ago

ZonePG requested a review from

arashb 1 year ago

Merge branch 'master' into master

4e0b6fc7

loadams removed review request from

arashb 1 year ago

loadams requested a review from

tohtana 1 year ago

tohtana approved these changes on 2024-08-21

tohtana merged e6fcc226 into master 1 year ago

Reviewers

tohtana

awan-10

Assignees

No one assigned

Labels

None yet

Milestone

No milestone