vllm
[Hardware][CPU] Enable mrope and support Qwen2-VL on CPU backend
#8770
Merged
Overview
Commits
9
Changes
View On GitHub

[Hardware][CPU] Enable mrope and support Qwen2-VL on CPU backend #8770

simon-mo merged 9 commits into vllm-project:main from Isotr0py:qwen2vl-cpu
Isotr0py
Isotr0py redactor cpu_model_runner
246a46c7
Isotr0py optimize docs
8fec49e5
Isotr0py support qwen2-vl on CPU
dd9bd6f2
Isotr0py mrope decoding
6bb42306
Isotr0py refactor
aa73afdb
github-actions
Isotr0py Merge remote-tracking branch 'upstream/main' into qwen2vl-cpu
f435001a
Isotr0py Merge branch 'qwen2vl-cpu' of https://github.com/Isotr0py/vllm into q…
d9ad2510
Isotr0py add model_is_mrope
12a7c6ea
Isotr0py Isotr0py marked this pull request as ready for review 1 year ago
DarkLight1337
DarkLight1337 commented on 2024-09-24
DarkLight1337 DarkLight1337 added ready
DarkLight1337
DarkLight1337 DarkLight1337 added x86 CPU
Isotr0py fix batching inference
3772037c
Isotr0py
DarkLight1337
DarkLight1337 approved these changes on 2024-09-25
DarkLight1337
Isotr0py
DarkLight1337 DarkLight1337 enabled auto-merge (squash) 1 year ago
simon-mo simon-mo merged c2395367 into main 1 year ago
Isotr0py Isotr0py deleted the qwen2vl-cpu branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ready
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum