vllm
d5fe3f70
- [Hybrid] Enable mamba prefix cache "align" mode with async scheduling (#33997)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
226 days ago
[Hybrid] Enable mamba prefix cache "align" mode with async scheduling (#33997) Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
References
#33997 - [Hybrid] Enable mamba prefix cache "align" mode with async scheduling
Author
tdoublep
Parents
73391a1b
Loading