llama.cpp
254098a2 - common : refactor common_sampler + grammar logic changes (#17937)

Commit
18 days ago
common : refactor common_sampler + grammar logic changes (#17937) * common : refactor common_sampler + grammar logic changes * tests : increase max_tokens to get needed response * batched : fix uninitialized samplers
Author
Parents
Loading