PR #26301 Implement multithreading in qgemm_kleidi

Implement multithreading in qgemm_kleidi #26301

hariharans29 merged 32 commits into microsoft:main from melkap01-Arm:melkap01_implement_mt_qgemm

hariharans29 commented on 2025-10-24

hariharans29 commented on 2025-10-28

edgchen1 commented on 2025-10-28

Implement multithreading in qgemm_kleidi

517e1661

fixes addressed:

bd05fcec

lhs_base_table buffer implemented inside TLS

75fee7ad

multithreaded qgemms coverage with single-multi threaded

e53e67b2

Test commit damdoo01

c2428fb9

Undo Test commit damdoo01

0479aeab

melkap01-Arm force pushed from 1c707b9b to 0479aeab 162 days ago

SME2 test case check brought on the Test() function, after rebase

9ef3b4c7

Merge branch 'microsoft:main' into melkap01_implement_mt_qgemm

32bf43c7

Dynamic Qgemm Prepack() refactored

b6ff3be3

Merge branch 'main' into melkap01_implement_mt_qgemm

7ed0e5c3

Quant Kernel log added, include corrected in dynamic qgemm test

76ba64f6

melkap01-Arm marked this pull request as draft 152 days ago

Merge branch 'microsoft:main' into melkap01_implement_mt_qgemm

6bac9a5c

provider test cases for keldiai dynamic qgemms added

f1605e58

hariharans29 commented on 2025-12-11

-Arm KleidiAI helper methods in Mlas space commented.

0c3748b3

Merge branch 'microsoft:main' into melkap01_implement_mt_qgemm

99fe8c5a

melkap01-Arm marked this pull request as ready for review 142 days ago

KleidiAI dynamic quantization supported by promoting 1D B tensor to 2D

47e4c92b

Merge branch 'microsoft:main' into melkap01_implement_mt_qgemm

fb8eefbf

Merge branch 'microsoft:main' into melkap01_implement_mt_qgemm

d9a26bf3

Merge branch 'microsoft:main' into melkap01_implement_mt_qgemm

cd80e567

Merge branch 'microsoft:main' into melkap01_implement_mt_qgemm

6356e687

lintrunner issue fixed

50dddaf0

Merge branch 'microsoft:main' into melkap01_implement_mt_qgemm

017a425a

Merge branch 'microsoft:main' into melkap01_implement_mt_qgemm

2ad388c6

Merge branch 'microsoft:main' into melkap01_implement_mt_qgemm

8dc8bc3c

Merge branch 'microsoft:main' into melkap01_implement_mt_qgemm

e000f04d

hariharans29 added release:1.24.0

hariharans29 commented on 2026-01-13

Address feedback on testcases and other issues

abfb0f33

Merge remote-tracking branch 'mel/main' into HEAD

3bf22f27

JonathanC-ARM force pushed from 64c59e53 to 3fcba09a 114 days ago

Move dynamic quant tests to more appropriate file

11c856cd

Merge branch 'microsoft:main' into melkap01_implement_mt_qgemm

0c60f4e9

JonathanC-ARM force pushed from 27d570c8 to 0c60f4e9 114 days ago

hariharans29 closed this 114 days ago

hariharans29 reopened this 114 days ago

hariharans29 commented on 2026-01-15

Removal of comment and debug print in test case

ce02e989

hariharans29 commented on 2026-01-16

hariharans29 requested a review from

copilot-pull-request-reviewer 114 days ago

copilot-pull-request-reviewer commented on 2026-01-16

Merge branch 'microsoft:main' into melkap01_implement_mt_qgemm

94d8fe58

Address review comments and update deps.txt

bb5c701a

hariharans29 approved these changes on 2026-01-16

hariharans29 enabled auto-merge (squash) 113 days ago

hariharans29 merged 4013dc19 into main 113 days ago

tianleiwu removed release:1.24.0

tianleiwu added cherry-picked

Reviewers

hariharans29

edgchen1

copilot-pull-request-reviewer

JonathanC-ARM

Assignees

No one assigned

Labels

cherry-picked

Milestone

No milestone

onnxruntime Implement multithreading in qgemm_kleidi #26301 Merged

Implement multithreading in qgemm_kleidi #26301

onnxruntime
Implement multithreading in qgemm_kleidi
#26301

Merged