llama.cpp
moe-cache : ensure CPU part does not wait for the cached experts
#31888
Merged

moe-cache : ensure CPU part does not wait for the cached experts #31888

sanmai
sanmai moe-cache : ensure CPU part does not wait for the cached experts
8955d29d
sanmai sanmai requested a review from am17an am17an 7 days ago
sanmai sanmai marked this pull request as ready for review 7 days ago
sanmai sanmai requested a review from CISC CISC 7 days ago
am17an
am17an approved these changes on 2026-11-08
ggerganov
ggerganov approved these changes on 2026-11-08
sanmai sanmai merged cf34d311 into master 7 days ago
sanmai sanmai deleted the fix/moe-cache-graph-order-gemma branch 7 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone