llama.cpp
e3af5563 - llama: store mrope data in KV cell (#16825)

Commit
88 days ago
llama: store mrope data in KV cell (#16825) * llama: store mrope data in KV cell * correct x,y ordering * address review comments * add consistency checks * Update src/llama-kv-cache.cpp Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> * add TODO * fix asan error * kv-cells : improve ext handling * cont : fix headers --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Author
Parents
Loading