Allow conversion of Llama / Mistral HF models #6144
ggerganov
merged
8 commits into
ggml-org:master
from
pcuenca:mistral-hf-conversion
Allow conversion of Mistral HF models
77f313e3
cebtenzzre
commented
on 2024-03-18
Homogenize Llama, Mistral, Mixtral under the same entry.
eecaf58e
Fix tokenizer, permute tensors
876b70d9
pcuenca
commented
on 2024-03-26
Merge remote-tracking branch 'origin/master' into mistral-hf-conversion
23ffda00
Use sentencepiece tokenizer, or fall back to hfft.
16ede02a
convert-hf : small fix for mypy
6dba2de0
convert-hf : fix duplicated block_count
9bf29e6e
convert-hf : add vocab size to metadata
f33b6c7b
cebtenzzre
approved these changes
on 2024-03-28
pcuenca
changed the title
Login to write a write a comment.
Login via GitHub