PR #1046 ggml : Q4_2 ARM

ggml : Q4_2 ARM #1046

ggerganov merged 5 commits into master from q4_2-arm

ggerganov force pushed from 0b575b62 to bbd29211 2 years ago

ggerganov marked this pull request as ready for review 2 years ago

ggerganov added generation quality

ggerganov requested a review from

sw 2 years ago

ggerganov commented on 2023-04-18

prusnak requested changes on 2023-04-18

ggml : Q4_2 ARM

e435b814

ggml : add ggml_is_quantized()

fe859297

llama : update llama_type_name() with Q4_2 entry

5e6b62ce

ggml : speed-up q4_2

3a790894

ggml : optimize q4_2 using vmlaq_n_f32 + vmulq_n_f32

5843b45b

ggerganov force pushed from f30dbf9a to 5843b45b 2 years ago

ggerganov merged 77a73403 into master 2 years ago

ggerganov deleted the q4_2-arm branch 2 years ago

ggerganov assigned

ggerganov 2 years ago

Reviewers

prusnak

Assignees

ggerganov

Labels

generation quality

Milestone

No milestone