llama.cpp
b0dcb819 - server: fix speculation after an image (#28715)

Commit
4 days ago
server: fix speculation after an image (#28715) * server: fix speculation after an image Pass the actual position to the drafter after an image, instead of the token count. Affects every drafter, not just DFlash. * rename draft n_past to pos0 n_past is used to denote number of tokens and this parameter is meant to be a position
Author
Parents
Loading