llama.cpp
12e5d990 - mtp: use inp_out_ids for skipping logit computation (#23433)

Commit
89 days ago
mtp: use inp_out_ids for skipping logit computation (#23433) when doing a follow-up decode for the draft model, we were always doing the logit computation even though it is not required.
Author
Parents
Loading