onnxruntime
d35db9b8 - [webgpu] Restore MatMulNBits workgroup size for Phi-3.5 (#23349)

Commit
1 year ago
[webgpu] Restore MatMulNBits workgroup size for Phi-3.5 (#23349) ### Description This change restores the MatMulNBits workgroup size from (8, 8, 1) back to (16, 8, 1) to resolve a performance regression observed on Intel iGPUs during token generation (M=1). ### Motivation and Context As above. Signed-off-by: Jianhui Dai <jianhui.j.dai@intel.com>
Author
Parents
Loading