llama.cpp
server: add strict prompt cache RAM limit
#25070
Merged

Commits
  • server: enforce prompt cache RAM limit
    tarruda committed 136 days ago
Loading