vllm
[V1] Reuse V0's memory_profiling util for gpu worker memory profiling
#19312

Merged

[V1] Reuse V0's memory_profiling util for gpu worker memory profiling #19312

houseroad merged 6 commits into vllm-project:main from yeqcharlotte:fix_mem_profile

yeqcharlotte requested a review from

WoosukKwon 224 days ago

yeqcharlotte requested a review from

robertgshaw2-redhat 224 days ago

yeqcharlotte requested a review from

njhill 224 days ago

yeqcharlotte requested a review from

ywang96 224 days ago

yeqcharlotte requested a review from

comaniac 224 days ago

yeqcharlotte requested a review from

alexm-redhat 224 days ago

gemini-code-assist commented on 2025-06-07

mergify added v1

gemini-code-assist commented on 2025-06-07

houseroad approved these changes on 2025-06-07

mergify added needs-rebase

ywang96 commented on 2025-06-09

use memory_profile util to determine kv memory

c23e73bc

merge conflict, move logging to debug

b13d767d

cleanup

83247bed

minor improvement

eb6cbdd5

yeqcharlotte force pushed to eb6cbdd5 222 days ago

mergify removed needs-rebase

fix

2dfc26db

yeqcharlotte changed the title ~~[Bugfix][V1] Fix memory profile to allow multiple servers to start on the same card~~ [V1] Reuse V0's memory_profile util for gpu worker memory profiling 222 days ago

yeqcharlotte commented on 2025-06-09

yeqcharlotte changed the title ~~[V1] Reuse V0's memory_profile util for gpu worker memory profiling~~ [V1] Reuse V0's memory_profiling util for gpu worker memory profiling 222 days ago

houseroad added ready

ProExpertProg commented on 2025-06-09

Datta0 commented on 2025-06-09

improve error message

4f0d18c5

houseroad merged cc867be1 into main 221 days ago

Reviewers

houseroad

ywang96

ProExpertProg

Datta0

gemini-code-assist

WoosukKwon

robertgshaw2-redhat

njhill

comaniac

alexm-redhat

Assignees

No one assigned

Labels

ready v1

Milestone

No milestone

vllm [V1] Reuse V0's memory_profiling util for gpu worker memory profiling #19312 Merged

[V1] Reuse V0's memory_profiling util for gpu worker memory profiling #19312

vllm
[V1] Reuse V0's memory_profiling util for gpu worker memory profiling
#19312

Merged