Integrate KleidiAI for MatMulNBits via MlasQNBitGemm #23627
Integrate KleidiAI for MatMulNBits and SQNBitGemm
bf699145
Use KleidiAI GitHub release
6d527e1c
Free scales when KleidiAI is used
de7f1e5d
Check if KleidiAI is already present
1a7744d6
Fix KleidiAI source path
f3d4b2e7
snnn
commented
on 2025-02-10
snnn
commented
on 2025-02-10
snnn
commented
on 2025-02-10
snnn
dismissed these changes
on 2025-02-10
Fix build errors
4f3336e6
Revert copyright
142a61b6
Add KleidiAI licenses
14b98a1b
Fix unused parameters
5a2445ab
Load scales for Float16
7da7c288
Update capitalization of parameter names
426175a4
Return const kernel references
1f932533
Rename CompInt8 functions
383f463c
Restore dotprod feature check
ebc8ea40
Reduce line lengths
9f814afb
Revert copyright
f2614e0f
Update formatting
959816ac
Add unused parameter name
baafe981
Rename HasZeroPoint
3650ab2a
Merge branch 'main' into kleidiai
a821728d
snnn
dismissed their stale review
297 days ago
Add USE_KLEIDIAI build flag
af12ffb2
snnn
commented
on 2025-03-05
snnn
commented
on 2025-03-05
snnn
commented
on 2025-03-05
snnn
commented
on 2025-03-05
snnn
commented
on 2025-03-05
snnn
commented
on 2025-03-05
snnn
commented
on 2025-03-05
Update CMake scripts
715d7344
Use kleidiai target
2a1cc4c9
Merge branch 'main' into kleidiai
577b8d8d
snnn
commented
on 2025-03-10
snnn
commented
on 2025-03-11
Add --no_kleidiai flag
3c3e731b
Fix architecture check
a9789281
Fix architecture check again
b1fca08e
Merge branch 'main' into kleidiai
4eb7dba8
Merge branch 'main' into kleidiai
9dc0b26a
Simplify build flags
d10f0584
edgchen1
approved these changes
on 2025-03-21
snnn
merged
90c5ffb5
into main 280 days ago
Assignees
No one assigned