vllm
[Bugfix] Remove hardcoded `head_size=256` for Deepseek v2 and v3
#12067

Merged

[Bugfix] Remove hardcoded `head_size=256` for Deepseek v2 and v3 #12067

Isotr0py merged 4 commits into vllm-project:main from Isotr0py:fix-deepseek-head

fix deepseek v2 and v3 head dim

e3486379

Isotr0py requested a review from

simon-mo 1 year ago

Isotr0py requested a review from

youkaichao 1 year ago

mgoin approved these changes on 2025-01-15

update test head_sizes

fb21cf0e

Isotr0py requested a review from

tlrmchlsmth 1 year ago

Isotr0py requested a review from

WoosukKwon 1 year ago

remove comment

7856937d

Isotr0py added ready

fix test head_sizes

9c9dd006

Isotr0py enabled auto-merge (squash) 1 year ago

Isotr0py merged dd7c9ad8 into main 1 year ago

Isotr0py deleted the fix-deepseek-head branch 1 year ago

Reviewers

mgoin

simon-mo

youkaichao

tlrmchlsmth

WoosukKwon

Assignees

No one assigned

Labels

ready

Milestone

No milestone