vllm
f70caef4 - [Perf] Cache `token_to_req_indices` for dsv4, 5x~6x kernel performance improvement (#47474)

Commit
26 days ago
[Perf] Cache `token_to_req_indices` for dsv4, 5x~6x kernel performance improvement (#47474) Signed-off-by: yewentao256 <zhyanwentao@126.com>
Author
Parents
Loading