llama.cpp
4b5f3cd6
- parallel : process system prompt once + configurable paramters + llama API
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
2 years ago
parallel : process system prompt once + configurable paramters + llama API
References
#3228 - llama : custom attention mask + parallel decoding + no context swaps
Author
ggerganov
Parents
82e20e9b
Loading