intel/auto-round

Pull Requests Commits

Merge branch 'main' into xuehao/cuda_ut

XuehaoSun committed 1 day ago

Verified 6db634a0

add sglang ut scripts

XuehaoSun committed 1 day ago

Verified 748bbafa

add online quant & offline sgl api generation cuda UT (#1198)

WeiweiZhang1 committed 1 day ago

Verified 3424d912

fix llama4 kv quant (#1199)

mengniwang95 committed 1 day ago

Verified dd8ce2e3

[Important Change] change mxfp4 to OCP definition (#1200)

wenhuach21 committed 1 day ago

Verified af202029

[Important Change]change mxfp8 to OCP standard (#1183)

wenhuach21 committed 1 day ago

Verified 4d3527f9

fix package install

XuehaoSun committed 1 day ago

Verified d66b03e9

fix requirements

XuehaoSun committed 1 day ago

Verified 314c56b0

update cuda ut requirements

XuehaoSun committed 1 day ago

Verified 08d2e5a5

rewrite fill_default_value logic for robust (#1165)

xin3he committed 1 day ago

Verified 17b67e18

UT refactor for preview (#1160)

xin3he committed 1 day ago

Verified cca98b42

Refactor module replacement (#1153)

yiliu30 committed 2 days ago

Verified 87d5580a

fix llama4 ut (#1197)

WeiweiZhang1 committed 2 days ago

Verified 0554a4d1

Update version (#1191)

XuehaoSun committed 2 days ago

Verified 6fb11688

fix cuda ut fail (#1189)

n1ck-guo committed 2 days ago

Verified adc1da67

[STEP 1] refactor output formats (#1159)

n1ck-guo committed 2 days ago

Verified 0dc5e9cf

Enable qwen3 vl moe quant and load (#1182)

WeiweiZhang1 committed 2 days ago

Verified d1935065

fix scale_dtype is None issue (#1185)

xin3he committed 3 days ago

Verified 440288fd

fix device mismatch issue for unifying qkv scale (#1175)

xin3he committed 4 days ago

Verified 13ba747f

Revert "[Important Update]change mxfp4 to ocp standard definition and fix scale dtype issue" (#1184)

xin3he committed 4 days ago

Verified ca1a87f7

Enable ark CI model test (#1177)

chensuyue committed 4 days ago

Verified 3a55a57a

Fix code for llmc llama4 quantization (#1161)

mengniwang95 committed 4 days ago

Verified 3c88b3b0

[Important Update]change mxfp4 to ocp standard definition and fix scale dtype issue (#1181)

wenhuach21 committed 4 days ago

Verified 94497f3b

Fix inference issue in ARK for AWQ format (#1170)

luoyu-intel committed 4 days ago

Verified fd5a1729

Deprecate awq infer ut (#1171)

WeiweiZhang1 committed 5 days ago

Verified 2800c3e4

Fix accuracy bug in the customized dataset (#1162)

wenhuach21 committed 8 days ago

Verified b53ead7d

Add G2-specific `FP8_STATIC` support (#1148)

yiliu30 committed 8 days ago

Verified 547d43f8

handle key not found issue (#1156)

xin3he committed 8 days ago

Verified dd9579e9

update norm bias tuning doc (#1155)

wenhuach21 committed 8 days ago

Verified 6723ef0a

fix asym quantization issue (#1158)

wenhuach21 committed 8 days ago

Verified 1c23c741

Older