PR #1225 CLBlast: q5_0, q5_1, q8_0 dequant kernels

CLBlast: q5_0, q5_1, q8_0 dequant kernels #1225

ggerganov merged 5 commits into ggml-org:master from 0cc4m:clblast-further-dequant-kernels

Implement q5_0, q5_1 and q8_0

9439da6f

Work around q5_0 OpenCL issue

1560c10f

Fix q8_0 dequant kernel

d6be497e

Move cl kernels into ggml-opencl.c

369d903e

LostRuins approved these changes on 2023-04-30

ggerganov commented on 2023-04-30

Use two memcpy calls for q5_0 buffer transfer

e69c924a

ggerganov approved these changes on 2023-04-30

ggerganov merged 76a88492 into master 2 years ago

0cc4m deleted the clblast-further-dequant-kernels branch 2 years ago

Reviewers

ggerganov

LostRuins

Assignees

No one assigned

Labels

None yet

Milestone

No milestone