llama.cpp
common : allow raw byte in SPM vocabs; don't crash if newline token is not found
#5478
Merged
Overview
Commits
2
Changes
View On GitHub
Commits
  • common : don't crash if newline token is not found
    akx committed 1 year ago
  • common : llama_byte_to_token: allow falling back to finding just the token byte in SPM vocabs
    akx committed 1 year ago
FAQ Terms Privacy Refunds Impressum
Loading