llama.cpp
2fa51c19 - model-conversion : add token ids to prompt token output [no ci] (#17863)

Commit
51 days ago
model-conversion : add token ids to prompt token output [no ci] (#17863) This commit adds the token ids to the printed prompt outputs. The motivation for this is that is can be useful to see the actual token ids alongside the token strings for debugging.
Author
Parents
Loading