intel/auto-round

Pull Requests Commits

Bump version to v0.9.3

XuehaoSun committed 8 hours ago

Verified 3560e0fe

fix scale_dtype is None issue (#1185)

xin3he committed 1 day ago

cd50aa02

fix device mismatch issue for unifying qkv scale (#1175)

xin3he committed 1 day ago

4ecab71c

Enable ark CI model test (#1177)

chensuyue committed 1 day ago

9a818fe4

Fix code for llmc llama4 quantization (#1161)

mengniwang95 committed 1 day ago

13c4c815

Fix inference issue in ARK for AWQ format (#1170)

luoyu-intel committed 1 day ago

e99da5ca

Deprecate awq infer ut (#1171)

WeiweiZhang1 committed 1 day ago

0dc34fe5

Fix accuracy bug in the customized dataset (#1162)

wenhuach21 committed 1 day ago

1bee95bd

handle key not found issue (#1156)

xin3he committed 6 days ago

00becda3

update norm bias tuning doc (#1155)

wenhuach21 committed 6 days ago

a60d9294

fix asym quantization issue (#1158)

wenhuach21 committed 6 days ago

7bef9219

Fix cuda test and llmc test (#1152)

XuehaoSun committed 7 days ago

86da0c4b

add more blog in README (#1147)

xin3he committed 7 days ago

927a30a2

update cd workflow (#1151)

chensuyue committed 7 days ago

4f64f123

fix bug and support shared_layers in cli (#1138)

xin3he committed 7 days ago

88b8ea34

add new posts and align the format (#1125)

xin3he committed 7 days ago

93d59c26

Added ark backend (#1075)

Zhenzhong1 committed 9 days ago

Verified 25926469

add llmc for cuda ut (#1145)

yiliu30 committed 10 days ago

Verified 2aeffe78

fix cuda ut fail (#1144)

n1ck-guo committed 10 days ago

Verified d1a41160

add low_cpu_mem_usage in cli (#1146)

n1ck-guo committed 10 days ago

Verified 0b74fe15

Fix device mismatch of nvfp fuse scale (#1143)

WeiweiZhang1 committed 10 days ago

Verified ec60acf7

update windows binary for alg_ext (#1142)

chensuyue committed 12 days ago

Verified e5481717

update document for eval (#1140)

xin3he committed 12 days ago

Verified 76b100c8

update readme (#1141)

wenhuach21 committed 12 days ago

Verified cde5160a

Add AutoRound binary build and publish workflow (#1132)

chensuyue committed 12 days ago

Verified b38f895e

fix bug of auto scheme with user layer config (#1133)

n1ck-guo committed 12 days ago

Verified f5b7a653

Remove duplicate packages (#1139)

XuehaoSun committed 12 days ago

Verified b25497f0

Enable load MXFP4/MXFP8 + FP8 KV (#1095)

yiliu30 committed 13 days ago

Verified 023921be

Upgrade llmc to main and add cuda UT (#1111)

yiliu30 committed 13 days ago

Verified 02aaa89e

fix regression (#1135)

xin3he committed 13 days ago

Verified 8874530d

Older