onnxruntime
0dacf7ee - MatMulNBits subgroup matrix 8x16x16: reduce robustness overhead (#33674)

Commit
4 days ago
MatMulNBits subgroup matrix 8x16x16: reduce robustness overhead (#33674) - Hoist uniforms.K out of the K-loop condition so the loop test doesn't reload the uniform buffer each iteration. - Compute the subgroupMatrixStore stride as max(N, kSgMatDimN) once so Tint's range analysis can skip its own stride clamp on every store. - Compute the subgroupMatrixLoad offset from the loop index instead of accumulating it.
Author
Parents
Loading