llama.cpp
Add single-client multi-prompt support
#4232
Merged

Commits
  • * add multiprompt support
    ziedbha committed 2 years ago
  • * cleanup
    ziedbha committed 2 years ago
  • * more cleanup
    ziedbha committed 2 years ago
  • * remove atomicity of id_gen, and change lock_guard to unique_lock on completion requests
    ziedbha committed 2 years ago
  • * remove all references to mutex_multitasks
    ziedbha committed 2 years ago
  • Update examples/server/server.cpp
    ziedbha committed 2 years ago
  • Update examples/server/server.cpp
    ziedbha committed 2 years ago
  • Update examples/server/server.cpp
    ziedbha committed 2 years ago
  • Update examples/server/server.cpp
    ziedbha committed 2 years ago
  • * change to set
    ziedbha committed 2 years ago
  • * merge with base
    ziedbha committed 2 years ago
Loading