llama.cpp

c8dc8d7f - allow multiple generations at the same time