vllm
[Benchmark] Add benchmark script for CPU offloading
#11533

Merged

[Benchmark] Add benchmark script for CPU offloading #11533

comaniac merged 3 commits into vllm-project:main from ApostaC:local-dev/cpu-offloading-benchmark

[Add] benchmark script for CPU offloading (long document QA use case)

5a9e3a4b

KuntaiDu added ready

DarkLight1337 requested a review from

comaniac 346 days ago

comaniac assigned

comaniac 346 days ago

comaniac commented on 2024-12-30

Simplify the script and address the reviews

46cbd938

ApostaC requested a review from

comaniac 343 days ago

comaniac approved these changes on 2024-12-31

[fix] docstring style

0fdc98e4

comaniac enabled auto-merge (squash) 343 days ago

comaniac merged 0c6f9985 into main 343 days ago

Reviewers

comaniac

Assignees

comaniac

Labels

ready

Milestone

No milestone