vllm
[Kimi-K3] Add option to shard the shared expert instead of replicating
#50656

Merged

[Kimi-K3] Add option to shard the shared expert instead of replicating #50656

tlrmchlsmth merged 2 commits into vllm-project:main from tlrmchlsmth:claude/kimi-k3-shared-expert-bandwidth-4dfe82

mergify added kimi

mergify added k3

tlrmchlsmth marked this pull request as ready for review 63 days ago

tlrmchlsmth requested a review from

DarkLight1337 63 days ago

tlrmchlsmth requested a review from

ywang96 63 days ago

tlrmchlsmth requested a review from

AndreasKaratzas 63 days ago

claude commented on 2026-08-01

jeejeelee commented on 2026-08-01

mergify added needs-rebase

[Kimi-K3] Optionally TP-shard sequence-parallel MLPs instead of repli…

822cc87f

tlrmchlsmth force pushed to 822cc87f 62 days ago

mergify removed needs-rebase

jeejeelee approved these changes on 2026-08-03

Merge branch 'main' into claude/kimi-k3-shared-expert-bandwidth-4dfe82

415424b8

jeejeelee added ready

tlrmchlsmth changed the title ~~[Kimi-K3] Optionally TP-shard sequence-parallel MLPs instead of replicating~~ [Kimi-K3] Add option to shard the shared expert instead of replicating 61 days ago

tlrmchlsmth merged 5df9999f into main 61 days ago

ZJY0516 added this to the v0.27.0 cherry picks milestone 57 days ago

Reviewers

jeejeelee

claude

DarkLight1337

ywang96

AndreasKaratzas

Assignees

No one assigned

Labels

ready kimi k3

Milestone

v0.27.0 cherry picks

vllm [Kimi-K3] Add option to shard the shared expert instead of replicating #50656 Merged

[Kimi-K3] Add option to shard the shared expert instead of replicating #50656

vllm
[Kimi-K3] Add option to shard the shared expert instead of replicating
#50656

Merged