llama.cpp
12e5d990
- mtp: use inp_out_ids for skipping logit computation (#23433)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
89 days ago
mtp: use inp_out_ids for skipping logit computation (#23433) when doing a follow-up decode for the draft model, we were always doing the logit computation even though it is not required.
References
#23433 - mtp: use inp_out_ids for skipping logit computation
Author
am17an
Parents
7ea23ddf
Loading