PR #47811 Add KV replicate feature when kv_head<tp_size

Add KV replicate feature when kv_head<tp_size #47811

kaixuanliu wants to merge 3 commits into huggingface:main from kaixuanliu:kv-replicate

add kv replicate feature when kv_heads<tp_size

06a3ccc5

update

c472b009

remove unnecessary update

ba2e6396

kaixuanliu changed the title ~~Kv replicate~~ Add KV replicate feature when kv_head<tp_size 7 days ago

kaixuanliu marked this pull request as ready for review 6 days ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone