llama.cpp
Add LLAMA_MOE_RANDOM_ROUTING=1 for benchmark-only random expert selection
#29539
Merged

Add LLAMA_MOE_RANDOM_ROUTING=1 for benchmark-only random expert selection #29539

gaugarg-nv
gaugarg-nv gaugarg-nv requested a review from CISC CISC 53 days ago
gaugarg-nv gaugarg-nv requested a review from ggerganov ggerganov 53 days ago
ggerganov
ggerganov commented on 2026-09-30
gaugarg-nv gaugarg-nv force pushed to 794253b7 33 days ago
gaugarg-nv
ggerganov
ggerganov approved these changes on 2026-11-16
gaugarg-nv Add LLAMA_MOE_RANDOM_ROUTING=1 for benchmark-only random expert selec…
633f5e95
gaugarg-nv Handle expert caching
d4ca78df
gaugarg-nv gaugarg-nv force pushed from 794253b7 to d4ca78df 2 days ago
gaugarg-nv gaugarg-nv requested a review 2 days ago
anujj
gaugarg-nv
anujj
anujj approved these changes on 2026-11-18
gaugarg-nv gaugarg-nv merged bba84088 into master 1 day ago
gaugarg-nv gaugarg-nv deleted the moe_random_expert_sel branch 1 day ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone