llama.cpp
server : add `n_discard` parameter to specify the number of tokens to discard when context is shifted
#6300
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
1
Changes
View On
GitHub
Commits
server : add `n_discard` parameter to specify the number of tokens to discard when context is shifted
kaetemi
committed
2 years ago
Loading