llama : fix unexpected graph reallocation in the k-pool models #29958
llama : fix unexpected graph reallocation in the k-pool models
2220411e
llama : drop the unused k-pool cache_safe graph API
46d2af84
tests : add a shared-seq graph reserve regression test
45e8cb9b
cont : add TODOs
d69cf37e
cont : fix comment
30e9f978
ggerganov
marked this pull request as ready for review 10 days ago
am17an
approved these changes
on 2026-10-05
cuda: match the moe weighted reduction on empty ubatches
bcc7ebc6
tests: build the rollback test only where internal symbols link
20ace9f9
tests: skip archs by name in the shared-seq reserve test
2211ab6f
ggerganov
merged
c173a53b
into master 9 days ago
ggerganov
deleted the gg/sparse-fix-realloc branch 9 days ago
Assignees
No one assigned
Labels
model
testing
ggml
CUDA
Login to write a write a comment.
Login via GitHub