onnxruntime
9cbf665b - [MLAS] Reject Arm® KleidiAI™ Q4 prepack with dynamic scales (#32068)

Commit
10 days ago
[MLAS] Reject Arm® KleidiAI™ Q4 prepack with dynamic scales (#32068) ### Description The Arm® KleidiAI™ Q4 path requires B and its scales to be packed together during session initialisation. Since runtime-provided scales are unavailable at that point, attempting to prepack B can pass a null scale pointer to the RHS packer causing undefined behavior. This change declines B prepacking for nodes with dynamic scales and ensures that the existing unpacked fallback is used at execution. This matches the existing handling of dynamic zero points. ### Motivation and Context This fixes a pre-existing bug uncovered during the Q4 refactor in #31720. The PR is a stacked follow-up based on the branch for #31720 and should be merged after it. The changes on this branch relevant to this PR are in the commit 76d61376bdad0662d35c98a70507c1c126dfb2ae that builds on top of the previous commit (b1c03d81f059a97ad0fe47956da46fc3e8729860) under review in #31720. --------- Signed-off-by: Martin Klacer <martin.klacer@arm.com>
Parents
Loading