vllm
f97e5029 - [Perf] Avoid more GPU<->CPU syncs on the model execution path (#51738)

Commit

29 days ago

[Perf] Avoid more GPU<->CPU syncs on the model execution path (#51738) Signed-off-by: Nick Hill <nickhill123@gmail.com>

References

Author

njhill

Parents