intel/auto-round

Pull Requests Commits

Merge branch 'main' into copilot/add-xpu-moe-decode-implementation

a32543254 committed 1 day ago

Verified 2ebe276f

Enable auto-round-bot for CI comments (#1993)

chensuyue committed 1 day ago

Verified b63a89f5

Implement AutoScheme support for model-free packing with validation a… (#1990)

xin3he committed 1 day ago

Verified cd10607c

Merge branch 'main' into copilot/add-xpu-moe-decode-implementation

a32543254 committed 1 day ago

Verified 7542c9cf

Update CUDA UT to cu130 (#1992)

XuehaoSun committed 1 day ago

Verified 52564823

fix the pre commit

a32543254 committed 1 day ago

0b5bb180

[AutoScheme] fix lm_head no_grad issue and support MOE model with shared mix_score (#1971)

xin3he committed 1 day ago

Verified e6b35d13

review: tighten shape-label filters to endswith to avoid substring false positives

Copilot committed 1 day ago

Verified 2b972f67

test(ark): default MoE perf tests to smallest shape; drop test_moe_model_perf

Copilot committed 1 day ago

Verified c1868d90

fix: use spawn instead of fork for dataset subprocess on macOS (#1980)

ramkrishs committed 2 days ago

Verified 1a7ed495

fix few bugs cause less accuracy of gguf format (#1960)

n1ck-guo committed 2 days ago

Verified e4404be7

Minor fix for auto-round-lib CI workflow (#1983)

chensuyue committed 2 days ago

Verified c945a182

fix: promote None-initialized kwarg to list in forward_capture (#1979)

ramkrishs committed 2 days ago

Verified 0622d472

fix: avoid silent weight loss when OffloadManager fails to save a block (#1982)

xin3he committed 2 days ago

Verified 64378412

rename the base rotation (deterministic/random hadamard) directory name. (#1956)

lkk12014402 committed 2 days ago

Verified 45dcb198

test(ark): drop base+deq(ms) column from MoE prefill perf table

Copilot committed 2 days ago

Verified 7cbc91e3

test(ark): add --minimax-real-only pytest flag to filter prefill perf shapes

Copilot committed 2 days ago

Verified 43b16490

Revert "test(ark): drop env-var toggling in prefill perf; restrict to "minimax real" shapes"

Copilot committed 2 days ago

Verified 88f78a39

test(ark): drop env-var toggling in prefill perf; restrict to "minimax real" shapes

Copilot committed 2 days ago

Verified 3da3d0a2

test(ark): add dpas-vs-baseline speedup column to MoE prefill perf table

Copilot committed 2 days ago

Verified 1d3b507c

perf(ark/moe): int4/int2 MoE dequant word-load fast path (PR-1)

Copilot committed 2 days ago

Verified 957f9d9e

feat(ark): S4-sym single-pass DPAS mixed-input mainloop

Copilot committed 2 days ago

Verified 27babb3a

test(ark): populate dpas column in INT4 MoE prefill perf

Copilot committed 2 days ago

Verified 827b7ff4

refactor(ark): drop INT8 asym DPAS; add INT4/INT2 sym via INT8 DPAS

Copilot committed 2 days ago

Verified 57488ab9

Revert "perf(ark): overlap asym asum pre-pass with DPAS launch (Lever 1)"

Copilot committed 2 days ago

Verified 152daf82

perf(ark): overlap asym asum pre-pass with DPAS launch (Lever 1)

Copilot committed 2 days ago

Verified 0363aceb

feat(ark): implement INT8 asym per-K-group DPAS grouped GEMM

Copilot committed 2 days ago

Verified 062b7a25

address review: drop no-op finally blocks and unused SG_K constant

Copilot committed 2 days ago

Verified 9616dc88

docs: add INT8 per-K-group DPAS section to README (EN + CN)

Copilot committed 2 days ago

Verified 414b8974

fix(ark): import make_moe_tensor into moe_dpas_int namespace

Copilot committed 2 days ago

Verified fb84de70

Older