llama.cpp
a6aa6f54 - sampler : remove "full-context windows" from history-based samplers (#26524)

Commit
15 days ago
sampler : remove "full-context windows" from history-based samplers (#26524) * Resolve -1 to 1024 instead of ctx-len for samplers Because of backend-sampling we initialize samplers before the complete llama_context is there. Therefore, we cannot infer the resolved context length yet at the time we construct the samplers. * Shared default of 64 for history-based samplers, remove context_size
Author
Parents
Loading