llama.cpp
3e12fbde - llama: avoid copying logits during prompt decode in MTP (#23198)

Commit
85 days ago
llama: avoid copying logits during prompt decode in MTP (#23198) * llama: avoid copying logits during prompt decode in MTP * review: update comment * llama-graph: call set_output for t_h_pre_norm
Author
Parents
Loading