vllm
offload prompt_embeds decode in render_prompts_async to avoid blocking
#43792
Merged
Merged