vllm
df450aa5 - [Bugfix] Fix num_heads value for simple connector when tp enabled (#12074)

Commit

1 year ago

[Bugfix] Fix num_heads value for simple connector when tp enabled (#12074) Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>

References

Author

ShangmingCai

Parents