llama.cpp

10da8c46 - unicode : add opt-in NFC normalization for Unigram tokenizers (#30390)

unicode : add opt-in NFC normalization for Unigram tokenizers (#30390) * unicode : add opt-in NFC normalization for Unigram tokenizers Note: used help from Codex, Sol 6.1 Medium * Fixing initial bot comments + linter error (using existing out instead of print) * removed test_nfc_tokenizer