onnxruntime
14a22c47 - [WebGPU] Skip MatMulNBits-DP4A for padded weights (#34128)

Commit
1 day ago
[WebGPU] Skip MatMulNBits-DP4A for padded weights (#34128) ### Description The DP4A shader requires unpadded weight rows and an integral scale stride (K / block_size). Skip DP4A when K is not evenly divisible by block_size, routing padded layouts to the floating-point kernel instead. Add a `Float16_4Bits_PaddedFinalBlock` regression test with K=384 and block_size=256. Use nonzero padding to verify that padded values do not contribute to the output. ### Motivation and Context See above.
Author
Parents
Loading