llama.cpp
c257a887 - cont : fix defrag erasing cells that didn't move

Commit

265 days ago

cont : fix defrag erasing cells that didn't move ggml-ci

References

gg/kv-fix-shift

#14081 - kv-cache : fix shift and defrag logic

Author

ggerganov

ggerganov

Parents

Loading