llama : add `llama_vocab`, functions -> methods, naming #11110
ggerganov
merged
9 commits into
master
from
gg/llama-refactor-7
llama : functions -> methods (#11110)
609ec7e0
llama : add struct llama_vocab to the API (#11156)
c725f691
hparams : move vocab params to llama_vocab (#11159)
45aab64e
vocab : more pimpl (#11165)
a857dc50
vocab : minor tokenization optimizations (#11160)
aeeb9420
slaren
approved these changes
on 2025-01-10
lora : update API names (#11167)
6efee8cb
llama : update API names to use correct prefix (#11174)
6df37bc2
ggerganov
commented
on 2025-01-11
vocab : llama_vocab_add_[be]os -> llama_vocab_get_add_[be]os (#11174)
6540935b
vocab : llama_vocab_n_vocab -> llama_vocab_n_tokens (#11174)
cbea4ba1
ggerganov
changed the title 
LostRuins
commented
on 2025-01-16
Login to write a write a comment.
Login via GitHub