llama.cpp
bba84088
- Add LLAMA_MOE_RANDOM_ROUTING=1 for benchmark-only random expert selection (#29539)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 day ago
Add LLAMA_MOE_RANDOM_ROUTING=1 for benchmark-only random expert selection (#29539) * Add LLAMA_MOE_RANDOM_ROUTING=1 for benchmark-only random expert selection * Handle expert caching
References
#29539 - Add LLAMA_MOE_RANDOM_ROUTING=1 for benchmark-only random expert selection
Author
gaugarg-nv
Parents
48a32194
Loading