CLBlast support #1164
ggerganov
merged
20 commits into
ggml-org:master
from
0cc4m:clblast-llama-cpp
Allow use of OpenCL GPU-based BLAS using ClBlast instead of OpenBLAS …
a908c37c
Improve ClBlast implementation, avoid recreating buffers, remove redu…
b7143c1a
Finish merge of ClBlast support
6f668707
Move CLBlast implementation to separate file
1b16b8c9
Add q4_2 and q4_3 CLBlast support, improve code
309af7fc
Double CLBlast speed by disabling OpenBLAS thread workaround
f469d9af
Fix device selection env variable names
8603c25e
Fix cast in opencl kernels
18cc05bd
Add CLBlast to CMakeLists.txt
ae73887f
Replace buffer pool with static buffers a, b, qb, c
daa5df51
slaren
commented
on 2023-04-25
slaren
commented
on 2023-04-25
slaren
commented
on 2023-04-25
Fix typos, use GGML_TYPE defines, improve code
36bfb3c1
slaren
commented
on 2023-04-25
SlyEcho
approved these changes
on 2023-04-25
Improve btype dequant kernel selection code, add error if type is uns…
13707100
slaren
approved these changes
on 2023-04-25
Improve code quality
2b0c6a56
SlyEcho
commented
on 2023-04-26
SlyEcho
commented
on 2023-04-26
Use c compiler for opencl files
b7464582
Simplify code, fix include
ce97a807
First check error, then release event
4a35ec9d
jon-chuang
commented
on 2023-04-26
jon-chuang
commented
on 2023-04-26
SlyEcho
commented
on 2023-04-27
SlyEcho
commented
on 2023-04-27
Make globals static, fix indentation
fafebff5
Rename dequant kernels file to conform with other file names
96346fb2
Fix import cl file name
bbfba5f7
SlyEcho
approved these changes
on 2023-04-27
ggerganov
commented
on 2023-04-28
ggerganov
approved these changes
on 2023-04-28
Merge branch 'master' into clblast-llama-cpp
4530d5c3
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub