intel/auto-round

Pull Requests Commits

yiliu30 committed 52 days ago

d12ceb3a

fix bug and support shared_layers in cli (#1138)

xin3he committed 52 days ago

Verified 746f32b6

add new posts and align the format (#1125)

xin3he committed 52 days ago

Verified 32b884e1

Added ark backend (#1075)

Zhenzhong1 committed 52 days ago

Verified 25926469

add llmc for cuda ut (#1145)

yiliu30 committed 52 days ago

Verified 2aeffe78

fix cuda ut fail (#1144)

n1ck-guo committed 53 days ago

Verified d1a41160

add low_cpu_mem_usage in cli (#1146)

n1ck-guo committed 53 days ago

Verified 0b74fe15

Fix device mismatch of nvfp fuse scale (#1143)

WeiweiZhang1 committed 53 days ago

Verified ec60acf7

update windows binary for alg_ext (#1142)

chensuyue committed 55 days ago

Verified e5481717

update document for eval (#1140)

xin3he committed 55 days ago

Verified 76b100c8

update readme (#1141)

wenhuach21 committed 55 days ago

Verified cde5160a

Add AutoRound binary build and publish workflow (#1132)

chensuyue committed 55 days ago

Verified b38f895e

fix bug of auto scheme with user layer config (#1133)

n1ck-guo committed 55 days ago

Verified f5b7a653

Remove duplicate packages (#1139)

XuehaoSun committed 55 days ago

Verified b25497f0

Enable load MXFP4/MXFP8 + FP8 KV (#1095)

yiliu30 committed 56 days ago

Verified 023921be

Upgrade llmc to main and add cuda UT (#1111)

yiliu30 committed 56 days ago

Verified 02aaa89e

fix regression (#1135)

xin3he committed 56 days ago

Verified 8874530d

Fix nvfp4&fp8 packing ram issue, refine all exporting format ram release for origin layer (#1129)

yiliu30 committed 56 days ago

Verified 77712681

fix bug of outside block layers do not use best_params (#1128)

n1ck-guo committed 56 days ago

Verified ba1c76cd

Use modelscope cache in CPU UT (#1124)

XuehaoSun committed 57 days ago

Verified fb43723c

fix bug of triton pow wrong data_type when enable torch compile (#1120)

n1ck-guo committed 57 days ago

Verified 3a5010d0

fix gguf extension bug (#1116)

wenhuach21 committed 57 days ago

Verified bd631496

remove result to cpu (#1115)

yiliu30 committed 59 days ago

Verified 5346cb73

fix quant fp8 model with iters=0 and scheme=nvfp4 (#1114)

n1ck-guo committed 59 days ago

Verified 99e4e75e

fix gguf packing device (#1105)

n1ck-guo committed 59 days ago

Verified 4f64730f

fix release version cuda ut fail (#1110)

n1ck-guo committed 59 days ago

Verified c9ac9a4d

fix auto-scheme/alg-ext multiple devices issue (#1107)

wenhuach21 committed 59 days ago

Verified 3e26b0d9

remove non-essential requirements (#1103)

n1ck-guo committed 59 days ago

Verified 36749155

move packeding res to cpu (#1104)

yiliu30 committed 59 days ago

Verified daa151d4

refine lmhead ut (#1106)

WeiweiZhang1 committed 60 days ago

Verified 814cf123

Older