intel/auto-round

Pull Requests Commits

fix scale dtype (#1207)

wenhuach21 committed 13 hours ago

Verified f670a25a

Fix llama4 kv quant (#1205)

mengniwang95 committed 14 hours ago

Verified cdd96a88

fix backend issue (#1209)

wenhuach21 committed 19 hours ago

Verified 95ffb8d3

remove ark support for cpu (#1206)

wenhuach21 committed 1 day ago

Verified 083b6351

fix bug of new version gptqmodel and fix few cuda ut (#1204)

n1ck-guo committed 1 day ago

Verified 68897933

Revert "set disable_opt_rtn as default for int8 RTN" (#1203)

wenhuach21 committed 2 days ago

Verified b3ec4455

set disable_opt_rtn as default for int8 RTN (#1201)

WeiweiZhang1 committed 2 days ago

Verified 56ad9d82

Add FP8 KV Support for DS (#1180)

yiliu30 committed 5 days ago

Verified d390de00

add online quant & offline sgl api generation cuda UT (#1198)

WeiweiZhang1 committed 5 days ago

Verified 3424d912

fix llama4 kv quant (#1199)

mengniwang95 committed 5 days ago

Verified dd8ce2e3

[Important Change] change mxfp4 to OCP definition (#1200)

wenhuach21 committed 5 days ago

Verified af202029

[Important Change]change mxfp8 to OCP standard (#1183)

wenhuach21 committed 5 days ago

Verified 4d3527f9

rewrite fill_default_value logic for robust (#1165)

xin3he committed 5 days ago

Verified 17b67e18

UT refactor for preview (#1160)

xin3he committed 5 days ago

Verified cca98b42

Refactor module replacement (#1153)

yiliu30 committed 6 days ago

Verified 87d5580a

fix llama4 ut (#1197)

WeiweiZhang1 committed 6 days ago

Verified 0554a4d1

Update version (#1191)

XuehaoSun committed 6 days ago

Verified 6fb11688

fix cuda ut fail (#1189)

n1ck-guo committed 6 days ago

Verified adc1da67

[STEP 1] refactor output formats (#1159)

n1ck-guo committed 6 days ago

Verified 0dc5e9cf

Enable qwen3 vl moe quant and load (#1182)

WeiweiZhang1 committed 6 days ago

Verified d1935065

fix scale_dtype is None issue (#1185)

xin3he committed 8 days ago

Verified 440288fd

fix device mismatch issue for unifying qkv scale (#1175)

xin3he committed 8 days ago

Verified 13ba747f

Revert "[Important Update]change mxfp4 to ocp standard definition and fix scale dtype issue" (#1184)

xin3he committed 8 days ago

Verified ca1a87f7

Enable ark CI model test (#1177)

chensuyue committed 8 days ago

Verified 3a55a57a

Fix code for llmc llama4 quantization (#1161)

mengniwang95 committed 8 days ago

Verified 3c88b3b0

[Important Update]change mxfp4 to ocp standard definition and fix scale dtype issue (#1181)

wenhuach21 committed 8 days ago

Verified 94497f3b

Fix inference issue in ARK for AWQ format (#1170)

luoyu-intel committed 8 days ago

Verified fd5a1729

Deprecate awq infer ut (#1171)

WeiweiZhang1 committed 9 days ago

Verified 2800c3e4

Fix accuracy bug in the customized dataset (#1162)

wenhuach21 committed 12 days ago

Verified b53ead7d

Add G2-specific `FP8_STATIC` support (#1148)

yiliu30 committed 12 days ago

Verified 547d43f8

Older