onnxruntime
KleidiAI SGEMM/IGEMM/Quantized MatMul - Modular MLAS API Changes for KleidiAI
#25187
Merged
Overview
Commits
53
Changes
View On GitHub

KleidiAI SGEMM/IGEMM/Quantized MatMul - Modular MLAS API Changes for KleidiAI #25187

hariharans29 merged 53 commits into microsoft:main from damdoo01-arm:kai_sgemm_igemm_quant_gemv
damdoo01-arm
damdoo01-arm
damdoo01-arm
damdoo01-arm damdoo01-arm marked this pull request as draft 1 year ago
edgchen1
edgchen1 commented on 2025-06-27
JonathanC-ARM CLNTFRAME-376: Add initial pipeline setup
b8d540d9
JonathanC-ARM Integrate initial KFI changes
d69d3f5f
JonathanC-ARM updated build and test to have mac stages
9e566649
dflavin-arm Sync with latest from old repo
5c03bcd1
damdoo001-arm Added Dynamic-Quantized Matmuls and GEMV
48b09e36
damdoo001-arm Fixed copyright attribution
972eef5e
Colm-in-Arm KFI-51 Requires target "kleidiai" error building ONNX RT on aarch64.
baa63df1
damdoo01-arm damdoo01-arm force pushed from 0b628b90 to ac8b6730 1 year ago
damdoo01-arm damdoo01-arm marked this pull request as ready for review 1 year ago
damdoo01-arm damdoo01-arm marked this pull request as draft 1 year ago
damdoo01-arm damdoo01-arm force pushed from ac8b6730 to baa63df1 1 year ago
damdoo001-arm MLAS API updates, mlas test fixes and ORT test fixes
a4068c12
damdoo01-arm damdoo01-arm marked this pull request as ready for review 1 year ago
damdoo001-arm Remove Arm CI internal directory inadvertently pushed previously
3b347669
damdoo001-arm Fix to iOS build
44199a57
damdoo001-arm 2nd attempt to fix ios build by force disabling KAI
459acf80
damdoo001-arm Wrap preprocessor ifdefs around dedicated KAI lib
c675ccdf
damdoo001-arm Lint fixes
8b8e6a03
damdoo001-arm Added Android/Linux CI build fixes plus fixed a layer parser fix
91008e9f
damdoo001-arm Fix to 2 more CI failures. 1. kleidiai dir not visible in some builds…
f984e816
damdoo001-arm Remove badly named directory
25e98157
damdoo001-arm Renamed kleidiai dir in lower case
3b9fd9aa
damdoo001-arm Merge branch 'main' into kai_sgemm_igemm_quant_gemv
fa558b3a
jywu-mysoft
azure-pipelines
QGemm call fixes that resolve the failing tests in CPU_U8S8_Precision…
db144a03
damdoo001-arm RESTRICT define created to overcome syntactical differences between c…
38083e65
damdoo001-arm Resolve conflicts in mlasi.h
8285fcf8
skottmckay
azure-pipelines
damdoo001-arm Added support to restrict keyword for msvc in KAI convolve function
967e3376
azure-pipelines
jywu-mysoft
azure-pipelines
damdoo001-arm Attempt to fix MSVC build by correctly linking kleidiai static library
ff5c2ea5
damdoo001-arm Syntax fix on prev
8e6f4ead
jywu-mysoft
azure-pipelines
jywu-mysoft
azure-pipelines
jywu-mysoft
azure-pipelines
damdoo01-arm
damdoo01-arm damdoo01-arm force pushed from 0156a8e1 to 939e012c 1 year ago
skottmckay
azure-pipelines
damdoo001-arm Reverting back to where we were before MSVC work
d38d63d1
damdoo01-arm damdoo01-arm force pushed from 5016e718 to d38d63d1 1 year ago
damdoo001-arm Staged for MSVC changes (now Linux/MacOS compatible)
dead330b
damdoo001-arm Workaround pending KleidiAI release
13a1c2bc
damdoo01-arm
jywu-mysoft
azure-pipelines
damdoo01-arm
damdoo001-arm Merge branch 'microsoft:main' into kai_sgemm_igemm_quant_gemv
8471aa4c
damdoo001-arm Merge branch 'microsoft:main' into kai_sgemm_igemm_quant_gemv
6da3217d
damdoo001-arm Reverted to KleidiAI 1.9 removing SME support for MSVC. Fixed duktape…
34ec660e
hariharans29
azure-pipelines
jywu-mysoft jywu-mysoft requested a review from hariharans29 hariharans29 1 year ago
jywu-mysoft jywu-mysoft added KleidiAI
damdoo001-arm KleidiAI build in Android
be0b6bfd
hariharans29
azure-pipelines
edgchen1
edgchen1 commented on 2025-07-21
github-advanced-security
github-advanced-security commented on 2025-07-21
hariharans29
hariharans29 commented on 2025-07-21
edgchen1
edgchen1 commented on 2025-07-21
edgchen1
edgchen1 commented on 2025-07-21
hariharans29
hariharans29 commented on 2025-07-21
hariharans29
hariharans29 commented on 2025-07-21
hariharans29
hariharans29 commented on 2025-07-21
hariharans29
hariharans29 commented on 2025-07-21
damdoo001-arm Checkpointing lint fixes after android enablement and addressing comm…
b82f64b6
hariharans29
hariharans29 commented on 2025-07-22
hariharans29
hariharans29 commented on 2025-07-22
damdoo001-arm Added MSVC 1944 flag and fixed syntax issue on quantize matmul c++ ca…
810ee40b
damdoo001-arm Reverted suggestion for 1944 gate, not possible without KAI release
6ef54d92
hariharans29
azure-pipelines
edgchen1
edgchen1 commented on 2025-07-22
hariharans29
hariharans29 commented on 2025-07-22
damdoo001-arm Most of the responses to comments (small number outstanding)
1169ccc2
hariharans29
azure-pipelines
hariharans29
hariharans29 commented on 2025-07-22
hariharans29
hariharans29 commented on 2025-07-22
hariharans29
hariharans29 commented on 2025-07-22
hariharans29
hariharans29 commented on 2025-07-22
hariharans29
hariharans29 commented on 2025-07-22
hariharans29
hariharans29 commented on 2025-07-22
github-advanced-security
github-advanced-security commented on 2025-07-23
hariharans29
hariharans29 commented on 2025-07-23
hariharans29
hariharans29 commented on 2025-07-23
damdoo001-arm Unit test updates and lint fixes (more to follow)
db2feff6
damdoo001-arm DynQuantMatMul enhancements
1aa31f9f
damdoo001-arm Corrected typo
62175e82
damdoo01-arm
damdoo01-arm commented on 2025-07-22
damdoo001-arm Added further comments
8e277e34
hariharans29
azure-pipelines
edgchen1
edgchen1 commented on 2025-07-23
damdoo001-arm Lint fix
72dd8770
hariharans29
azure-pipelines
edgchen1
edgchen1 commented on 2025-07-23
damdoo001-arm Temporary commit to check changes
795ed285
damdoo001-arm Refactor overrides for kleidi func calls and included fix for matmul …
baa2eb1b
hariharans29
azure-pipelines
damdoo001-arm Merge branch 'microsoft:main' into kai_sgemm_igemm_quant_gemv
9c7360e4
damdoo001-arm Reinstated SME checks where still required
00fda4a6
damdoo001-arm Added Dynamic Quantization Unit Test
43799128
damdoo001-arm Fixed lint issues
74e8bf11
hariharans29
azure-pipelines
damdoo001-arm Further updates to comments, dyn quant matmul changes only pending
e9c72916
hariharans29
azure-pipelines
edgchen1
edgchen1 commented on 2025-07-24
edgchen1
edgchen1 commented on 2025-07-24
jywu-mysoft jywu-mysoft added release:1.23.0
damdoo001-arm Dynamic Quant Matmul changes based on feed back
b201e5ed
hariharans29
azure-pipelines
damdoo001-arm Tidy-up based on MS feedback
dba3f0b7
damdoo001-arm Lint fixes
52961eab
damdoo001-arm Added Jonathan's guard conditions for DynQuantMatMul
8523708c
hariharans29
azure-pipelines
damdoo001-arm Fixed unused variable error after guard include
d45c6bb1
damdoo001-arm Removed global variable and fixed transA override (removed inadverten…
47535127
hariharans29
azure-pipelines
edgchen1
edgchen1 commented on 2025-07-24
edgchen1
edgchen1 commented on 2025-07-24
edgchen1
edgchen1 commented on 2025-07-24
edgchen1
edgchen1 commented on 2025-07-24
edgchen1
edgchen1 commented on 2025-07-24
edgchen1
edgchen1 commented on 2025-07-24
damdoo01-arm
edgchen1
edgchen1 approved these changes on 2025-07-25
hariharans29
hariharans29 approved these changes on 2025-07-25
hariharans29 hariharans29 merged cd450d15 into main 1 year ago
snnn snnn removed release:1.23.0
snnn

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
KleidiAI
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum