PR #24573 [EPLB] Reduce EPLB Inference Overhead

[EPLB] Reduce EPLB Inference Overhead #24573

tlrmchlsmth merged 6 commits into vllm-project:main from abmfy:eplb-compile

[Feature] Compile expert replica selection

56eafd95

[Feature] Use module pseudo-random in replica selection

f0cc507d

Merge branch 'main' into eplb-compile

5baf3392

gemini-code-assist commented on 2025-09-10

[Style] Add `indices_type` guard

1db8a3cd

robertgshaw2-redhat requested a review from

ProExpertProg 162 days ago

[Style] Fix lint errors

db7ffbef

robertgshaw2-redhat added eplb

tlrmchlsmth added ready

tlrmchlsmth approved these changes on 2025-09-22

Merge branch 'main' into eplb-compile

be310d00

tlrmchlsmth requested a review from

mgoin 150 days ago

tlrmchlsmth added this to the v0.10.3 milestone 150 days ago

tlrmchlsmth enabled auto-merge (squash) 150 days ago

tlrmchlsmth merged 06a41334 into main 150 days ago

Reviewers

tlrmchlsmth

gemini-code-assist

ProExpertProg

mgoin

Assignees

No one assigned

Labels

ready

Milestone

v0.11.0