llama.cpp
convert-hf : support direct Q8_0 conversion
#7234
Merged

convert-hf : support direct Q8_0 conversion #7234

compilade merged 3 commits into master from compilade/q8_0-convert-hf
compilade
compilade convert-hf : support q8_0 conversion
d7e199e4
compilade convert-hf: add missing ftype
2b1e5ea3
compilade compilade added enhancement
compilade compilade added python
compilade compilade added Review Complexity : Medium
ggerganov
ggerganov approved these changes on 2024-05-12
compilade convert-hf : add missing ftype to Baichuan and Xverse
65a1a585
compilade compilade merged ee522250 into master 1 year ago
LostRuins
CISC
CISC commented on 2024-05-23

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone