llama.cpp
4eb19514 - kv-cache : support attention rotation for heterogeneous iSWA (#21513)

Commit

104 days ago

kv-cache : support attention rotation for heterogeneous iSWA (#21513) * kv-cache : support attention rotation for heterogeneous iSWA * cont : remove assert

References

#21513 - kv-cache : support attention rotation for heterogeneous iSWA

Author

ggerganov

Parents

957d717c

llama.cpp 4eb19514 - kv-cache : support attention rotation for heterogeneous iSWA (#21513)

llama.cpp
4eb19514 - kv-cache : support attention rotation for heterogeneous iSWA (#21513)