DeepSpeed
Add support of Qwen models (7b, 14b, 72b) to DeepSpeed-FastGen
#4913

Merged

Add support of Qwen models (7b, 14b, 72b) to DeepSpeed-FastGen #4913

loadams merged 7 commits into deepspeedai:master from ZonePG:master

ZonePG requested a review from

mrwyattii 2 years ago

ZonePG requested a review from

awan-10 2 years ago

ZonePG requested a review from

arashb 2 years ago

ZonePG force pushed from f66b27cd to 31e75803 2 years ago

Add support of Qwen models (7b, 14b, 72b) to DeepSpeed-FastGen

31d924c2

ZonePG force pushed from 31e75803 to 31d924c2 2 years ago

add comment for Qwen bf16 difference

1a7f6fe8

mrwyattii approved these changes on 2024-01-09