onnxruntime
[MLAS] Add CPU DynamicQuantMatMulFp8 contrib op with MLAS FP8 fallback
#28416
Open
Overview
Commits
26
Changes
View On GitHub

[MLAS] Add CPU DynamicQuantMatMulFp8 contrib op with MLAS FP8 fallback #28416

melkap01-Arm wants to merge 26 commits into microsoft:main from melkap01-Arm:fp8_DynamicQuantMatMul_Support
melkap01-Arm
melkap01-Arm Add CPU DynamicQuantMatMulFp8 contrib op with MLAS FP8 fallback
536fb3f4
melkap01-Arm wording for tile replaced with block
b53b1c5a
melkap01-Arm Merge branch 'microsoft:main' into fp8_DynamicQuantMatMul_Support
563dcaa4
melkap01-Arm cleaning the zp checks from MlasFp8GemmBatch after symmetric quantis…
c5fe8e10
melkap01-Arm melkap01-Arm marked this pull request as ready for review 65 days ago
hariharans29 hariharans29 requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 65 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-05-11
melkap01-Arm documentation updated for failing build, copilot comment addressed
a258ad8d
melkap01-Arm Reusable A buffer implemented before gemm, tests covering all fp8 typ…
7fb80e7b
melkap01-Arm Merge branch 'microsoft:main' into fp8_DynamicQuantMatMul_Support
864b1a89
melkap01-Arm redundant lines removed
1966da42
melkap01-Arm melkap01-Arm marked this pull request as draft 63 days ago
melkap01-Arm Optimize DynamicQuantMatMulFp8 A quantization
98ea9fff
melkap01-Arm melkap01-Arm marked this pull request as ready for review 63 days ago
melkap01-Arm Merge branch 'microsoft:main' into fp8_DynamicQuantMatMul_Support
473287ec
melkap01-Arm Merge branch 'microsoft:main' into fp8_DynamicQuantMatMul_Support
10c88a71
hariharans29 hariharans29 changed the title Add CPU DynamicQuantMatMulFp8 contrib op with MLAS FP8 fallback [MLAS] Add CPU DynamicQuantMatMulFp8 contrib op with MLAS FP8 fallback 61 days ago
melkap01-Arm Merge branch 'microsoft:main' into fp8_DynamicQuantMatMul_Support
e041589c
melkap01-Arm Merge branch 'microsoft:main' into fp8_DynamicQuantMatMul_Support
b913105a
melkap01-Arm Merge branch 'microsoft:main' into fp8_DynamicQuantMatMul_Support
16efd04b
melkap01-Arm documentation difference patched
4655e914
melkap01-Arm Merge branch 'microsoft:main' into fp8_DynamicQuantMatMul_Support
f3018d92
melkap01-Arm Merge branch 'microsoft:main' into fp8_DynamicQuantMatMul_Support
cc27b945
hariharans29 hariharans29 requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 57 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-05-19
melkap01-Arm answering copilot comment regarding N==0 case
93592f39
melkap01-Arm Merge branch 'microsoft:main' into fp8_DynamicQuantMatMul_Support
cdb66cf0
melkap01-Arm melkap01-Arm marked this pull request as draft 56 days ago
melkap01-Arm LHS,RHS block layouts changed, scales adjusted
f5424a9b
melkap01-Arm melkap01-Arm marked this pull request as ready for review 55 days ago
hariharans29 hariharans29 requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 55 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-05-20
melkap01-Arm review comments addressed, docs patched
3696f367
melkap01-Arm Merge branch 'microsoft:main' into fp8_DynamicQuantMatMul_Support
68e20378
hariharans29 hariharans29 requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 54 days ago
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-05-21
melkap01-Arm copilot comments addressed
5e9f1b93
melkap01-Arm Merge branch 'microsoft:main' into fp8_DynamicQuantMatMul_Support
68027e92
melkap01-Arm Merge branch 'microsoft:main' into fp8_DynamicQuantMatMul_Support
7769b190
melkap01-Arm enum representation cleaned
183c5f7f
hariharans29

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum