llama.cpp
llama : fix unexpected graph reallocation in the k-pool models
#29958
Merged

llama : fix unexpected graph reallocation in the k-pool models #29958

ggerganov merged 8 commits into master from gg/sparse-fix-realloc
ggerganov
ggerganov llama : fix unexpected graph reallocation in the k-pool models
2220411e
ggerganov llama : drop the unused k-pool cache_safe graph API
46d2af84
github-actions github-actions added model
ggerganov tests : add a shared-seq graph reserve regression test
45e8cb9b
ggerganov cont : add TODOs
d69cf37e
github-actions github-actions added testing
ggerganov cont : fix comment
30e9f978
ggerganov ggerganov marked this pull request as ready for review 10 days ago
ggerganov ggerganov requested a review from CISC CISC 10 days ago
ggerganov
ggerganov commented on 2026-10-04
am17an
am17an approved these changes on 2026-10-05
ServeurpersoCom cuda: match the moe weighted reduction on empty ubatches
bcc7ebc6
ServeurpersoCom ServeurpersoCom requested a review 9 days ago
github-actions github-actions added ggml
github-actions github-actions added CUDA
ServeurpersoCom
ServeurpersoCom
ServeurpersoCom approved these changes on 2026-10-05
ServeurpersoCom
ServeurpersoCom tests: build the rollback test only where internal symbols link
20ace9f9
ggerganov
ggerganov commented on 2026-10-05
ServeurpersoCom tests: skip archs by name in the shared-seq reserve test
2211ab6f
ggerganov
ggerganov ggerganov merged c173a53b into master 9 days ago
ggerganov ggerganov deleted the gg/sparse-fix-realloc branch 9 days ago
ggerganov
0cc4m
0cc4m
0cc4m
rillomas
rillomas

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone