llama.cpp
ggml-cpu: Add CPU backend support for KleidiAI library
#11390
Merged
Overview
Commits
10
Changes
View On GitHub

ggml-cpu: Add CPU backend support for KleidiAI library #11390

ggerganov merged 10 commits into ggml-org:master from chaxu01:feature/kleidiai-cpu-backend
chaxu01
chaxu01 ggml-cpu: Add CPU backend support for KleidiAI library
6adca19c
github-actions github-actions added ggml
slaren
slaren commented on 2025-01-24
njsyw1997
chaxu01
chaxu01 Add environmental variable GGML_KLEIDIAI_SME
119d3bf9
slaren
njsyw1997
chaxu01
chaxu01
njsyw1997
chaxu01
chaxu01 Add support for multithread LHS conversion
f4eb1b38
max-krasnyansky
max-krasnyansky
max-krasnyansky
max-krasnyansky
chaxu01 Switch kernel selection order to dotprod and i8mm
3e08f37b
chaxu01
slaren
slaren commented on 2025-02-06
chaxu01 updates for review comments
9edd1073
chaxu01
slaren
slaren commented on 2025-02-07
slaren
slaren commented on 2025-02-07
chaxu01 More updates for review comments
e04880fa
ggerganov
ggerganov commented on 2025-02-10
chaxu01 Reorganize and rename KleidiAI files
ca0c8b6b
chaxu01
ggerganov
ggerganov commented on 2025-02-10
chaxu01 Move ggml-cpu-traits.h to source file
02315a8d
chaxu01
ggerganov
chaxu01
chaxu01 Update cmake for SME build and add alignment for SME
09436f4c
chaxu01
rmatif
chaxu01
slaren
slaren commented on 2025-02-19
ggerganov
ggerganov approved these changes on 2025-02-20
chaxu01 Remove append GGML_USE_CPU_KLEIDIAI to the GGML_CDEF_PUBLIC list
710552fd
chaxu01
slaren
slaren approved these changes on 2025-02-20
ggerganov ggerganov merged c5d91a74 into master 308 days ago
jishminor
chaxu01 chaxu01 deleted the feature/kleidiai-cpu-backend branch 79 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ggml
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum