llama.cpp
gguf-split: split and merge gguf per batch of tensors
#6135

Merged

gguf-split: split and merge gguf per batch of tensors #6135

phymbert merged 5 commits into ggml-org:master from phymbert:hp/feature/gguf-split

gguf-split: split and merge gguf files per tensor

59222320

phymbert added demo

phymbert added need feedback

phymbert requested a review from

Artefact2 1 year ago

phymbert requested a review from

ggerganov 1 year ago

phymbert requested a review from

slaren 1 year ago

phymbert requested a review from

ngxson 1 year ago

ngxson commented on 2024-03-18

ngxson approved these changes on 2024-03-18

gguf-split: build with make toolchain

33c72d02

gguf-split: rename `--split-tensors-size` to `--split-max-tensors`. S…

b3a94dd9

phymbert removed review request from

Artefact2 1 year ago

phymbert removed review request from

slaren 1 year ago

split : minor style + fix compile warnings

7f0e73b2

ggerganov approved these changes on 2024-03-19

gguf-split: remove --upload not implemented

2dc6830a

phymbert removed demo

phymbert removed need feedback

phymbert changed the title ~~proposal: gguf-split: split and merge gguf per batch of tensors~~ gguf-split: split and merge gguf per batch of tensors 1 year ago

phymbert merged d0d5de42 into master 1 year ago

phymbert deleted the hp/feature/gguf-split branch 1 year ago

Reviewers

ggerganov

ngxson

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

llama.cpp gguf-split: split and merge gguf per batch of tensors #6135 Merged

gguf-split: split and merge gguf per batch of tensors #6135

llama.cpp
gguf-split: split and merge gguf per batch of tensors
#6135

Merged