llama.cpp
6443ddd9 - llama : use reserve/emplace_back in sampler_sample (#9534)

Commit
1 year ago
llama : use reserve/emplace_back in sampler_sample (#9534) This commit updates the llama_sampler_sample function to use reserve and emplace_back for the vector of llama_token_data structs. The motivation for this change is to avoid the creation of n_vocab default-constructed llama_token_data structs which are then immediately overwritten.
Author
Parents
Loading