vllm
1528e079 - [Perf] Avoid pageable HtoD transfer in MinTokensLogitsProcessor (#29826)

Commit

29 days ago

[Perf] Avoid pageable HtoD transfer in MinTokensLogitsProcessor (#29826) Signed-off-by: jthomson04 <jwillthomson19@gmail.com>

References

Author

jthomson04

Parents