vllm
[Feature][Perf] Support Selective CPU Weight Offloading
#34535

Merged

[Feature][Perf] Support Selective CPU Weight Offloading #34535

vllm-bot merged 4 commits into vllm-project:main from wzhao18:wzhao/cpu-offload-moe-only

wzhao18 requested a review from

heheda12345 85 days ago

mergify added v1

Only offload moe weights

8240011a

Parameterize offloading weights

06f1ba14

format code

fe927de4

wzhao18 force pushed to fe927de4 85 days ago

gemini-code-assist commented on 2026-02-13

mgoin approved these changes on 2026-02-13

mgoin added ready

mgoin added nvidia

Fix pydantic validation error

8435c8bc

vllm-bot merged b37b6797 into main 85 days ago

Reviewers

mgoin

gemini-code-assist

heheda12345

Assignees

No one assigned

Labels

ready v1 nvidia

Milestone

No milestone