llama.cpp
4b0c638b - common : disable KV cache shifting automatically for unsupported models (#11053)

Commit
349 days ago
common : disable KV cache shifting automatically for unsupported models (#11053) * Disable KV cache shifting automatically for unsupported models instead of exiting directly Signed-off-by: Molly Sophia <mollysophia379@gmail.com> * Update common/common.cpp Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> --------- Signed-off-by: Molly Sophia <mollysophia379@gmail.com> Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Author
Parents
Loading