llama.cpp
gguf-split: split and merge gguf per batch of tensors
#6135

Merged

Commits

gguf-split: split and merge gguf files per tensor

phymbert committed 1 year ago
gguf-split: build with make toolchain

phymbert committed 1 year ago
gguf-split: rename `--split-tensors-size` to `--split-max-tensors`. Set general.split_count KV to all split

phymbert committed 1 year ago
split : minor style + fix compile warnings

ggerganov committed 1 year ago
gguf-split: remove --upload not implemented

phymbert committed 1 year ago