llama.cpp
d6cf9acb - llama : add a GPU cache for MoE experts kept in host memory (#29887)

Commit
24 days ago
llama : add a GPU cache for MoE experts kept in host memory (#29887) * llama : add a GPU cache for MoE experts kept in host memory Assisted-by: Claude * use llama_moe_cache_ptr
Author
Parents
Loading