vllm
df450aa5 - [Bugfix] Fix num_heads value for simple connector when tp enabled (#12074)
Commit
View On GitHub
Comment changes are shownComment changes are hidden
Commit
142 days ago
[Bugfix] Fix num_heads value for simple connector when tp enabled (#12074) Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Author
ShangmingCai ShangmingCai
Parents
bbe5f9de
  • vllm/distributed/kv_transfer/kv_connector
    • File
      simple_connector.py
FAQ Terms Privacy Refunds Impressum