llama.cpp
gguf-py: add support for I8, I16 and I32
#6045
Merged

gguf-py: add support for I8, I16 and I32 #6045

ggerganov merged 4 commits into ggml-org:master from certik:gguf_writer
certik
certik Refactor dtype handling to be extensible
b7e9d5c8
certik Add support for I8, I16 and I32
dc0e4d8e
certik Add support for I8, I16 and I32 to gguf_writer
c5423753
certik Add support for I8, I16, I32 to gguf_reader
fc5d6e65
certik certik force pushed from b4d2c4dd to fc5d6e65 1 year ago
ggerganov
ggerganov
ggerganov approved these changes on 2024-03-14
ggerganov ggerganov merged 3ca23481 into master 1 year ago
certik certik deleted the gguf_writer branch 1 year ago
certik
ggerganov
certik

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone