intel/auto-round

Pull Requests Commits

fix cuda ut (#1020)

n1ck-guo committed 55 days ago

Verified 797f476a

dispatch model with real max memory (#1022)

xin3he committed 55 days ago

Verified 255322fb

add num_device check for set_auto_device_map_for_block_with_tuning (#1021)

xin3he committed 55 days ago

Verified a3d422df

Including auto_scheme.default_alg into binary (#1018)

chensuyue committed 56 days ago

Verified 6d03ec89

fix multi cuda ut bug (#1014)

n1ck-guo committed 56 days ago

Verified d00cc855

add ut for gguf alg_ext and update so file (#1012)

n1ck-guo committed 56 days ago

Verified 5c2f1bd7

fix bug (#1011)

wenhuach21 committed 57 days ago

Verified e3f96105

Minor refactor for LLMC (#993)

yiliu30 committed 57 days ago

Verified 6af724a5

add device list to clear memory (#1009)

wenhuach21 committed 57 days ago

Verified 1d02da16

Fix param missing bug (#1008)

mengniwang95 committed 57 days ago

Verified 7f9fa0ee

fix cuda CI (#1010)

Kaihui-intel committed 57 days ago

Verified b7ef006b

fix multiple devices issue in Compressor and AutoScheme (#1007)

wenhuach21 committed 59 days ago

Verified 344b40cf

Fix non auto device map (#1005)

WeiweiZhang1 committed 60 days ago

Verified cd54e705

fix multiple devices map issue in calibration (#1003)

wenhuach21 committed 60 days ago

Verified ead6f296

Fix diffusion multi-device ut issue (#1002)

mengniwang95 committed 60 days ago

Verified f6745fd9

Support for immediate saving to reduce ram usage (#965)

Kaihui-intel committed 60 days ago

Verified daeb3bb7

Refine exllamav2 ut (#1001)

WeiweiZhang1 committed 60 days ago

Verified 758b2390

refine md tables (#994)

WeiweiZhang1 committed 60 days ago

Verified c0aa30ab

fix mllm device_map ut (#1000)

Kaihui-intel committed 60 days ago

Verified 4aeca3ae

fix cuda ut bug (#999)

n1ck-guo committed 60 days ago

Verified d1bf7e8d

Reduce peak gpu memory usage and support moe estimation (#981)

xin3he committed 61 days ago

Verified 84e9a776

fix lm head bug and rm clear_mem_reach_threhold (#997)

wenhuach21 committed 61 days ago

Verified 284eecdd

[CI] Update python to 3.12 and torch to 2.8.0 (#741)

XuehaoSun committed 62 days ago

Verified 268f7dda

fix bug of cannot create adam compressor (#992)

n1ck-guo committed 62 days ago

Verified 05cab090

support model_dtype and fix bug of scheme contains quotes, mllm eval (#985)

n1ck-guo committed 63 days ago

Verified cd308ddb

add support for Magistral-Small (#980)

n1ck-guo committed 63 days ago

Verified dc6a6d3f

fix guff scheme and device_map bug (#969)

n1ck-guo committed 63 days ago

Verified be146c7f

update bits (#986)

xin3he committed 63 days ago

Verified 4afbe0ab

cli support for positional arguments model (#979)

n1ck-guo committed 64 days ago

Verified b9245b58

refine readme (#978)

wenhuach21 committed 64 days ago

Verified 3f7bdace

Newer Older