vllm
c50e105a - [Model Runner V2] Avoid prepare prefill kernel launch overhead (#34780)

Commit

1 day ago

[Model Runner V2] Avoid prepare prefill kernel launch overhead (#34780) Signed-off-by: Nick Hill <nickhill123@gmail.com>

References

Author

njhill

Parents