llama.cpp
b141e5f6 - server : enable KV cache defrag by default (#10233)

Commit

1 year ago

server : enable KV cache defrag by default (#10233) ggml-ci

References

#10233 - server : enable KV cache defrag by default

Author

ggerganov

ggerganov

Parents

Loading