intel/auto-round

Pull Requests Commits

docs: document Qwen3-MoE int4-sym prefill/decode perf tests

Copilot committed 6 days ago

Verified 42949b74

test: add qwen3-moe int4-sym prefill and decode perf benchmarks

Copilot committed 6 days ago

Verified 353543da

perf: raise the MoE auto-dispatch decode cutoff from 32 to 128 tokens

Copilot committed 10 days ago

Verified 03ca8774

perf: N-block the FP8 K-split decode GEMV and drop the per-call routing sync

Copilot committed 10 days ago

Verified 51328f36

docs: describe the K-split FP8 decode GEMV (EN + CN)

Copilot committed 11 days ago

Verified e43b98f7

perf: add K-split lane-parallel FP8 MoE decode GEMV

Copilot committed 11 days ago

Verified 7102f0ec

fix: restore test_perf_fp8_per_tensor definition; make fp8_decode_mode allocation-free

Copilot committed 11 days ago

Verified c6f67a13

test: FP8 decode-mode + DPAS parity/perf coverage; docs: FP8 decode section (EN+CN)

Copilot committed 11 days ago

Verified 3423da8f

perf: word-native FP8 decode + decode-tuned FP8 DPAS dispatch

Copilot committed 11 days ago

Verified 6cd81921

docs: update int4 decode perf notes for word-native nibble decode

Copilot committed 11 days ago

Verified a2827941

perf: speed up int4-sym MoE decode with word-native nibble decode

Copilot committed 11 days ago

Verified 610a005d

test,docs: cover the new int4 decode paths and document the tuning knobs

Copilot committed 11 days ago

Verified 4ec9d7fe

perf(ark): vectorize int4 decode GEMV loads, hoist activation sums, pool the repack buffer

Copilot committed 11 days ago

Verified e4d25c5d

perf(ark): decode int4-sym nibbles through the asym unsigned path (^0x88 sign-flip)

Copilot committed 11 days ago

Verified 211e95f8

perf(ark): route decode-sized int4-sym moe through the asym scalar GEMV

Copilot committed 11 days ago

Verified 1f7b6313

perf(ark): use A_avg_M tile ladder for int4 moe sym decode (match vllm-xpu-kernels)

Copilot committed 11 days ago

Verified 5b88c2ec

perf: trim device-timeline overhead on S4 DPAS decode hot path

Copilot committed 11 days ago

Verified ba2c18d7

perf: reuse persistent atomic buffer in S4 DPAS dispatch

Copilot committed 11 days ago

Verified 33960828

docs+test: document decode S4 DPAS path and add A/B parity assertion

Copilot committed 12 days ago

Verified a3c82ced

feat: add dedicated w4a16_policy_m_8 decode DPAS dispatch for S4 sym

Copilot committed 12 days ago

Verified c8ef1b8e

perf: hoist routing filter out of int4 coalesced decode hot loop

Copilot committed 12 days ago

Verified 7db3d5f2

fix: qualify TOKEN_BLOCK with moe_decode_detail namespace

Copilot committed 12 days ago

Verified d80a9a13

perf: gate coalesced int4 decode on repack amortization to fix tiny-batch regression

Copilot committed 12 days ago

Verified 590ce59a

fix: parameterize MoEDecodeRepackInt4 kernel name to avoid duplicate mangled names

Copilot committed 12 days ago

Verified cc939f8d

perf: block tokens-per-expert in coalesced int4 MoE decode GEMV

Copilot committed 12 days ago

Verified 8c732ed8

perf: coalesce int4 MoE decode weight loads via on-device N-tiled repack

Copilot committed 12 days ago

Verified c20c0b2c

perf: hoist per-group scale and split accumulators in int4 MoE decode GEMV

Copilot committed 12 days ago

Verified a1480af3

test: add int4-sym DPAS vs scalar token-count sweep for MoE decode threshold tuning

Copilot committed 12 days ago

Verified 23ba0dbf

fix: lower default MoE auto-decode threshold 256 -> 32

Copilot committed 13 days ago

Verified 87b617ea

fix: split orphaned int8 block out of int4-sym dpas perf test

Copilot committed 13 days ago

Verified ffd2926c

Older