auto-round
fba16566 - perf(ark): take the 256-row prefill tile everywhere and batch the act-quant loads

Commit

6 days ago

perf(ark): take the 256-row prefill tile everywhere and batch the act-quant loads Co-authored-by: a32543254 <53296245+a32543254@users.noreply.github.com>

References

#2143 - feat: W4A8 ARK XPU MoE kernel (int4 weight / int8 compute) with prefill + decode

Author

Copilot

Parents

95e78533

auto-round fba16566 - perf(ark): take the 256-row prefill tile everywhere and batch the act-quant loads

auto-round
fba16566 - perf(ark): take the 256-row prefill tile everywhere and batch the act-quant loads