llama.cpp
d6cf9acb
- llama : add a GPU cache for MoE experts kept in host memory (#29887)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
24 days ago
llama : add a GPU cache for MoE experts kept in host memory (#29887) * llama : add a GPU cache for MoE experts kept in host memory Assisted-by: Claude * use llama_moe_cache_ptr
References
#29887 - llama : add a GPU cache for MoE experts kept in host memory
Author
am17an
Parents
42c787e8
Loading