PR #19852 [JS/WebGPU] Optimize MatMulNBits

[JS/WebGPU] Optimize MatMulNBits #19852

satyajandhyala merged 12 commits into main from sajandhy/webgpu_optimize_matmulnbits

Temporarily remove uniforms to debug.

d114d9a2

Vectorize MatMulNBits.

f1860048

Use uppercase letters for M, N and K.

a825fbb6

Restore uniforms.

daa37308

Added a testcase with 8x8 output.

171362b0

satyajandhyala added ep:WebGPU

Added output values vectorization.

2361183d

Revert "Use uppercase letters for M, N and K."

f8131e77

Formating changes.

602f07f6

Formatting

e65f0502

typo

143faa79

Use mat4x2 and mat2x4 instead of array when aComponent is 2 or 4.

e99fd21d

satyajandhyala marked this pull request as ready for review 2 years ago

Fix lint errors.

357a3a76

satyajandhyala changed the title ~~[WIP][JS/WebGPU] Optimize MatMulNBits~~ [JS/WebGPU] Optimize MatMulNBits 2 years ago

guschmue approved these changes on 2024-03-13

satyajandhyala merged ed250b88 into main 2 years ago

satyajandhyala deleted the sajandhy/webgpu_optimize_matmulnbits branch 2 years ago

Reviewers

guschmue

Assignees

No one assigned

Labels

ep:WebGPU

Milestone

No milestone