auto-round
7db3d5f2
- perf: hoist routing filter out of int4 coalesced decode hot loop
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
29 days ago
perf: hoist routing filter out of int4 coalesced decode hot loop Co-authored-by: a32543254 <53296245+a32543254@users.noreply.github.com>
References
#2111 - Optimize INT4 MoE prefill/decode (sym) XPU kernels with dedicated w4a16 tiling
#2143 - feat: W4A8 ARK XPU MoE kernel (int4 weight / int8 compute) with prefill + decode
Author
Copilot
Parents
d80a9a13
Loading