`quantize`: add imatrix and dataset metadata in GGUF #6658
phymbert
merged
16 commits into
master
from
hp/quantize/imatrix-metadata
imatrix: save the dataset file used in the output file
d766c5a6
llama: support kv overrides type string string
01e77959
common: factorize KV Overrides parsing between common and server
a9202fb1
quantize: add imatrix n entries and dataset KV metadata
262c95ab
llama: remove kv override str_value initialization as it does not com…
cbc43aa4
phymbert
commented
on 2024-04-13
phymbert
commented
on 2024-04-13
phymbert
commented
on 2024-04-13
quantize: add imatrix m_last_call as `quantize.imatrix.chunks_count`
851de160
quantize: add imatrix filename in KV
0d82da6f
ggerganov
commented
on 2024-04-16
Merge remote-tracking branch 'refs/remotes/origin/master' into hp/qua…
ea0ad80a
llama: add llama_model_kv_override_free
82e4187f
phymbert
commented
on 2024-04-19
common: add llama_model_kv_override_free
aa0e28f8
Merge remote-tracking branch 'refs/remotes/origin/master' into hp/qua…
2606bc97
ggerganov
commented
on 2024-04-20
llama: finally move the string KV override value to the stack
4bd26644
llama : minor
5cf8ccb1
ggerganov
approved these changes
on 2024-04-21
no need to add a NUL to the std::vector, std::string can be initializ…
8360e0c9
Merge remote-tracking branch 'refs/remotes/origin/master' into hp/qua…
b54eede8
kv override: ensure string termination
bcbdd28c
slaren
approved these changes
on 2024-04-26
Login to write a write a comment.
Login via GitHub