intel/auto-round

Pull Requests Commits

add replace lm-head

yiliu30 committed 83 days ago

969ab907

yiliu30 committed 87 days ago

f6950feb

yiliu30 committed 87 days ago

f87372a4

fix bug of lm_head and dispatch model,gguf eval (#1025)

n1ck-guo committed 87 days ago

Verified 2fb3ee1b

disable itrex format first (#998)

WeiweiZhang1 committed 88 days ago

Verified 395602b7

fix cuda ut (#1020)

n1ck-guo committed 88 days ago

Verified 797f476a

dispatch model with real max memory (#1022)

xin3he committed 88 days ago

Verified 255322fb

add num_device check for set_auto_device_map_for_block_with_tuning (#1021)

xin3he committed 88 days ago

Verified a3d422df

Including auto_scheme.default_alg into binary (#1018)

chensuyue committed 88 days ago

Verified 6d03ec89

fix multi cuda ut bug (#1014)

n1ck-guo committed 88 days ago

Verified d00cc855

add ut for gguf alg_ext and update so file (#1012)

n1ck-guo committed 89 days ago

Verified 5c2f1bd7

fix bug (#1011)

wenhuach21 committed 90 days ago

Verified e3f96105

Minor refactor for LLMC (#993)

yiliu30 committed 90 days ago

Verified 6af724a5

add device list to clear memory (#1009)

wenhuach21 committed 90 days ago

Verified 1d02da16

Fix param missing bug (#1008)

mengniwang95 committed 90 days ago

Verified 7f9fa0ee

fix cuda CI (#1010)

Kaihui-intel committed 90 days ago

Verified b7ef006b

fix multiple devices issue in Compressor and AutoScheme (#1007)

wenhuach21 committed 92 days ago

Verified 344b40cf

Fix non auto device map (#1005)

WeiweiZhang1 committed 93 days ago

Verified cd54e705

fix multiple devices map issue in calibration (#1003)

wenhuach21 committed 93 days ago

Verified ead6f296

Fix diffusion multi-device ut issue (#1002)

mengniwang95 committed 93 days ago

Verified f6745fd9

Support for immediate saving to reduce ram usage (#965)

Kaihui-intel committed 93 days ago

Verified daeb3bb7

Refine exllamav2 ut (#1001)

WeiweiZhang1 committed 93 days ago

Verified 758b2390

refine md tables (#994)

WeiweiZhang1 committed 93 days ago

Verified c0aa30ab

fix mllm device_map ut (#1000)

Kaihui-intel committed 93 days ago

Verified 4aeca3ae

fix cuda ut bug (#999)

n1ck-guo committed 93 days ago

Verified d1bf7e8d

Reduce peak gpu memory usage and support moe estimation (#981)

xin3he committed 94 days ago

Verified 84e9a776

fix lm head bug and rm clear_mem_reach_threhold (#997)

wenhuach21 committed 94 days ago

Verified 284eecdd

[CI] Update python to 3.12 and torch to 2.8.0 (#741)

XuehaoSun committed 95 days ago

Verified 268f7dda

fix bug of cannot create adam compressor (#992)

n1ck-guo committed 95 days ago

Verified 05cab090

support model_dtype and fix bug of scheme contains quotes, mllm eval (#985)

n1ck-guo committed 95 days ago

Verified cd308ddb

Older