vllm
f70caef4
- [Perf] Cache `token_to_req_indices` for dsv4, 5x~6x kernel performance improvement (#47474)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
26 days ago
[Perf] Cache `token_to_req_indices` for dsv4, 5x~6x kernel performance improvement (#47474) Signed-off-by: yewentao256 <zhyanwentao@126.com>
References
#47474 - [Perf] Cache `token_to_req_indices` for dsv4, 5x~6x kernel performance improvement
Author
yewentao256
Parents
8d8ec383
Loading