llama.cpp
831d7e74 - server: read the GGUF metadata once per model

Commit
6 days ago
server: read the GGUF metadata once per model Read the decision type and the trained context in a single GGUF open, accept only a UINT32 context length like the model loader, and reset n_ctx_train with the other caps so a failed refresh drops it.
Parents
Loading