llama.cpp
8d0dc476 - llama2.c: convert special-cased "<0xXX>" single byte tokens from tokenizer.bin

Commit
2 years ago
llama2.c: convert special-cased "<0xXX>" single byte tokens from tokenizer.bin
Author
ochafik
Parents
Loading