llama.cpp
23b5e12e - simple : update error message for KV cache check (#4324)

Commit
1 year ago
simple : update error message for KV cache check (#4324) This commit updates the error message that is printed when the KV cache is not big enough to hold all the prompt and generated tokens. Specifically it removes the reference to n_parallel and replaces it with n_len. Signed-off-by: Daniel Bevenius <daniel.bevenius@gmail.com>
Author
Parents
  • examples/simple
    • File
      simple.cpp
Loading