llama.cpp
dc7cef9f
- llama-run : fix context size (#11094)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
346 days ago
llama-run : fix context size (#11094) Set `n_ctx` equal to `n_batch` in `Opt` class. Now context size is a more reasonable 2048. Signed-off-by: Eric Curtin <ecurtin@redhat.com>
References
#11094 - llama-run : fix context size
Author
ericcurtin
Parents
ecebbd29
Loading