vllm
elastic_ep: Fix issues with repeated scale up/down cycles
#37131

Merged

elastic_ep: Fix issues with repeated scale up/down cycles #37131

tlrmchlsmth merged 4 commits into vllm-project:main from itayalroy:elastic_ep_repeated_scaling

itayalroy requested a review from

njhill 141 days ago

mergify added nvidia

mergify added v1

gemini-code-assist commented on 2026-03-16

itayalroy force pushed from 28f7904d 141 days ago

itayalroy force pushed 141 days ago

itayalroy force pushed to bd4cf16a 141 days ago

Fix PyNCCL memory leaks

9c5eb990

Refactor Elastic EP load path and EPLB suppression

ba7a6340

Fix Elastic EP removing-engine shutdown ordering

9e6f3770

itayalroy force pushed to 9e6f3770 141 days ago

tlrmchlsmth assigned

tlrmchlsmth 140 days ago

SageMoore approved these changes on 2026-03-18

tlrmchlsmth added ready

tlrmchlsmth approved these changes on 2026-03-20

Merge branch 'main' into elastic_ep_repeated_scaling

04c2bd13

tlrmchlsmth enabled auto-merge (squash) 137 days ago

tlrmchlsmth merged c57d38d6 into main 137 days ago

Reviewers

tlrmchlsmth

SageMoore

gemini-code-assist

njhill

Assignees

tlrmchlsmth

Labels

ready v1 nvidia

Milestone

No milestone