llama.cpp
1.5 bit: we can do even better
#5999
Merged
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
6
Changes
View On
GitHub
1.5 bit: we can do even better
#5999
ggerganov
merged 6 commits into
master
from
ik/even_better_iq1s
iq1_s: we can do even better
82380acf
iq1_s: make scalar and AVX2 work with the new version
c09f7349
iq1_s: make Neon work with new version.
4fba3e00
iq1_s: make Metal work with new version
da4528bc
iq1_s: very slightly faster dequantize on Metal
436c65e1
iq1_s: fix dequantize on the CPU
5440a127
ikawrakow
added
breaking change
ggerganov
approved these changes on 2024-03-11
ggerganov
merged
44ca159f
into master
1 year ago
Login to write a write a comment.
Login via GitHub
Reviewers
ggerganov
Assignees
No one assigned
Labels
breaking change
Milestone
No milestone
Login to write a write a comment.
Login via GitHub