llama.cpp
56e659a0 - fix perplexity after c-api refactor (#390)

Commit
2 years ago
fix perplexity after c-api refactor (#390) * preallocate a buffer of fitting size for tokenization (utils.cpp) * don't create a new std::string (especially here, where it's usually large)
Author
Parents
  • File
    main.cpp
  • File
    utils.cpp