vllm
24b0205f - [V1][Frontend] Coalesce bunched `RequestOutput`s (#12298)

Commit

329 days ago

[V1][Frontend] Coalesce bunched `RequestOutput`s (#12298) Signed-off-by: Nick Hill <nhill@redhat.com> Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

References

#12298 - [V1][Frontend] Coalesce bunched `RequestOutput`s

Author

njhill

Parents

c5cffcd0

vllm 24b0205f - [V1][Frontend] Coalesce bunched `RequestOutput`s (#12298)

vllm
24b0205f - [V1][Frontend] Coalesce bunched `RequestOutput`s (#12298)