llama.cpp
ee1a0ec9 - llama : add option for greedy sampling with probs (#3813)

Commit
1 year ago
llama : add option for greedy sampling with probs (#3813) * llama : add option for greedy sampling with probs * llama : add comment about llama_sample_token_greedy() missing probs * sampling : temp == 0.0 -> no probs, temp < 0.0 -> probs
Author
Parents
  • common
    • File
      common.cpp
    • File
      sampling.cpp
  • examples/speculative
    • File
      speculative.cpp
  • File
    llama.h