intel/auto-round

Pull Requests Commits

Add Performance Test (#1561)

XuehaoSun committed 22 days ago

Verified 29f02751

support hadamard transform for mxfp4 with rtn or autoround method (#1515)

lkk12014402 committed 23 days ago

Verified a49550bc

Enable CUDA CI (#1473)

XuehaoSun committed 23 days ago

Verified 4f1a8dea

update awq backend infos, refine UT (#1581)

WeiweiZhang1 committed 23 days ago

Verified 06dfc838

disable torch compile for gguf with alg_ext (#1582)

wenhuach21 committed 23 days ago

Verified fcb0d2d1

[regression] fix copy missing tensors for llama4 (#1579)

xin3he committed 23 days ago

Verified 38c70355

Fix compatibility with latest compressed_tensors compressor refactor (#1576)

yiliu30 committed 23 days ago

Verified 49d2dbb0

add rtn quant func (#1564)

mengniwang95 committed 23 days ago

Verified 1ff8d028

fix deadlock issue when do quantization on hpu. (#1571)

lkk12014402 committed 23 days ago

Verified 093324c1

Update document for Qwen Omni quantized models (#1568)

lvliang-intel committed 23 days ago

Verified 92f0aaa3

Refine CPU RAM offload strategy (#1544)

lvliang-intel committed 23 days ago

Verified c37add63

add gptqmodel:awq backend support and keep autoawq WQLinear_GEMM for compatibility (#1545)

WeiweiZhang1 committed 23 days ago

Verified 84448965

Refine model save folder name (#1549)

Kaihui-intel committed 24 days ago

Verified 68d5568b

Fix reload issue for lm_head quantization and update CI to cover it (#1563)

xin3he committed 24 days ago

Verified 13fbffee

Freeze compressed-tensors & llmc version temporary (#1562)

chensuyue committed 24 days ago

Verified 4cc0cce4

temporary pin compressed-tensors version for llmcompressor (#1560)

chensuyue committed 25 days ago

Verified 3a8c26e6

Support Qwen3 and Qwen2.5 Omni model quantization (#1404)

lvliang-intel committed 25 days ago

Verified 91af35ff

Fix MoE for llama/gpt-oss (#1557)

yiliu30 committed 25 days ago

Verified 555052e7

fix missing change for compress_layer_names and add UTs (#1556)

xin3he committed 25 days ago

Verified 6d17bbfb

Fix shard finalization issue to prevent skipping non-LLM tail layers (#1548)

lvliang-intel committed 26 days ago

Verified 81e79a14

Optimize mtp tensor process by compiling layer names once for all (#1554)

xin3he committed 26 days ago

Verified 1111bcd4

Use AR_WORK_SPACE/offload/ as base dir for offload temp files (#1552)

yiliu30 committed 26 days ago

Verified 803912aa

fix wrong match of ignore_layers and use warning instead of error for mismatch (#1553)

xin3he committed 26 days ago

Verified d8ee85c8

Support block-wise fp8 quant (#1487)

mengniwang95 committed 26 days ago

Verified e6600591

fix google/gemma-3-4b-it (#1547)

xin3he committed 27 days ago

Verified b5fc1724

Add markdown-link-check (#1531)

XuehaoSun committed 27 days ago

Verified 50c4c7f4

fix alg_ext torch compile issue (#1540)

wenhuach21 committed 30 days ago

Verified 9d54ddcc

Fix CI test_transformers issue caused by transformers 5.3.0 (#1535)

lvliang-intel committed 30 days ago

Verified 7b087fb2

Fix sglang ut (#1541)

mengniwang95 committed 30 days ago

Verified 53f2b0e0

support MTP module WOQ quantization and step3p5 model quantization (#1526)

xin3he committed 30 days ago

Verified 42fdb069

Newer Older