llama.cpp
c837981b - py : add Phi-1.5/Phi-2 tokenizer (#9361)

Commit
1 year ago
py : add Phi-1.5/Phi-2 tokenizer (#9361) * add phi2 tokenizer * add phi name to convert_hf_to_gguf_update.py * make tokenizer_pre consistent; llama.cpp work
Author
Parents
Loading