llama.cpp
c1596f63
- llama : fix kv cache heuristic when context is less than 32
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
llama : fix kv cache heuristic when context is less than 32
References
#3228 - llama : custom attention mask + parallel decoding + no context swaps
Author
ggerganov
Parents
88451600
Loading