llama.cpp
Add LLAMA_MOE_RANDOM_ROUTING=1 for benchmark-only random expert selection
#29539
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
2
Changes
View On
GitHub
Commits
Add LLAMA_MOE_RANDOM_ROUTING=1 for benchmark-only random expert selection
gaugarg-nv
committed
3 days ago
Handle expert caching
gaugarg-nv
committed
3 days ago
Loading