llama.cpp
f1ea2062 - batch: migrate speculative, mtmd and server to batch_ext (#29385)

Commit
30 days ago
batch: migrate speculative, mtmd and server to batch_ext (#29385) * adapt common * add common_batch * wip * wip: spec * cont * common_speculative_process * server_batch to use common_batch * rm some stale calls Assisted-by: Claude Fable 5.1 * migrate mtmd * handle imrope, handle return val of add()/add_embd() * add spec zeros vector * add warning on zero fill path
Author
Parents
Loading