llama.cpp
e262947d - common : add command-line arg to disable KV cache offloading

Commit

2 years ago

common : add command-line arg to disable KV cache offloading

References

#4309 - llama : per-layer KV cache

Author

ggerganov

ggerganov

Parents

Loading