vllm
[Bugfix] Fix num_heads value for simple connector when tp enabled
#12074
Merged
Overview
Commits
1
Changes
View On GitHub

[Bugfix] Fix num_heads value for simple connector when tp enabled #12074

KuntaiDu merged 1 commit into vllm-project:main from kvcache-ai:fix_num_heads_with_tp
ShangmingCai
ShangmingCai [Bugfix] Fix num_heads value when tp enabled for simple connector.
b38d91d7
github-actions
ShangmingCai ShangmingCai changed the title [Bugfix] Fix num_heads value for simple connector when tp enabled. [Bugfix] Fix num_heads value for simple connector when tp enabled 327 days ago
ShangmingCai
KuntaiDu
KuntaiDu approved these changes on 2025-01-18
KuntaiDu KuntaiDu enabled auto-merge (squash) 323 days ago
github-actions github-actions added ready
ShangmingCai
DarkLight1337
KuntaiDu KuntaiDu merged df450aa5 into main 322 days ago
ShangmingCai ShangmingCai deleted the fix_num_heads_with_tp branch 322 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ready
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum