vllm
offload prompt_embeds decode in render_prompts_async to avoid blocking
#43792
Merged
Merged
offload prompt_embeds decode in render_prompts_async to avoid blocking #43792
DarkLight1337
merged
3 commits into
vllm-project:main
from
gagandhakrey:perf/render-prompts-async-offload
offload prompt_embeds decode in render_prompts_async to avoid blockin…
48528e20
Merge branch 'main' into perf/render-prompts-async-offload
e24a2816
gagandhakrey
changed the title 
qthequartermasterman
approved these changes
on 2026-05-29
DarkLight1337
approved these changes
on 2026-05-29
Merge branch 'main' into perf/render-prompts-async-offload
57e4318c
Reviewers
Assignees
No one assigned
Labels
ready
verified
Milestone
No milestone
Login to write a write a comment.
Login via GitHub