llama.cpp
Replace MoE LRU cache with a 50/50 SLRU cache
#30637
Merged
Overview
Commits
1
Changes
View On GitHub

Replace MoE LRU cache with a 50/50 SLRU cache #30637

CISC merged 1 commit into ggml-org:master from eapache:ehuus/moe-slru50
eapache
eapache Replace MoE LRU cache with a 50/50 SLRU cache
c1bebe35
eapache eapache marked this pull request as ready for review 28 days ago
eapache eapache requested a review from ggerganov ggerganov 28 days ago
eapache
am17an
am17an
am17an approved these changes on 2026-10-16
am17an am17an added merge ready
CISC CISC merged 33d6135c into master 24 days ago
eapache eapache deleted the ehuus/moe-slru50 branch 24 days ago
kudraw
eapache
eapache
eapache
am17an
eapache
kudraw
eapache
kudraw

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
merge ready
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum