llama.cpp
convert : ignore tokens if their IDs are within [0, vocab_size)
#3831
Merged
Merged
convert : ignore tokens if their IDs are within [0, vocab_size) #3831
KerfuffleV2
merged
1 commit into
master
from
apply-3585
convert : ignore tokens if their IDs are within [0, vocab_size)
de7e0912
KerfuffleV2
approved these changes
on 2023-10-28
Login to write a write a comment.
Login via GitHub