llama.cpp
Faster AVX2 dot product for IQ2_XS
#5187
Merged
Overview
Commits
3
Changes
View On GitHub

Faster AVX2 dot product for IQ2_XS #5187

ikawrakow merged 3 commits into master from ik/faster_iq2xs_avx2
ikawrakow
iq2xs: faster AVX2 dot product
76f7befa
iq2xs: small AVX2 imrovement
f9d22dab
ikawrakow ikawrakow changed the title Faster AVX2 dor product for IQ2_XS Faster AVX2 dot product for IQ2_XS 1 year ago
PeterReid
ikawrakow
PeterReid
PeterReid
PeterReid
ikawrakow
Speed up computing sign bits in AVX2 iq2_xs dot product
aa6698a8
ikawrakow ikawrakow marked this pull request as ready for review 1 year ago
ggerganov
ggerganov approved these changes on 2024-01-30
ikawrakow ikawrakow merged 8e14e3dd into master 1 year ago
ikawrakow ikawrakow deleted the ik/faster_iq2xs_avx2 branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum