text-generation-inference
719d7b4d
- Disabling flashinfer/prefix caching on odd head_dim
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Disabling flashinfer/prefix caching on odd head_dim
Author
Narsil
Committer
Narsil
Parents
78579104
Loading
text-generation-inference
719d7b4d - Disabling flashinfer/prefix caching on odd head_dim
