intel/auto-round

Pull Requests Commits
disable itrex format first (#998)
WeiweiZhang1 committed 340 days ago
Verified 395602b7
fix cuda ut (#1020)
n1ck-guo committed 340 days ago
Verified 797f476a
dispatch model with real max memory (#1022)
xin3he committed 340 days ago
Verified 255322fb
add num_device check for set_auto_device_map_for_block_with_tuning (#1021)
xin3he committed 340 days ago
Verified a3d422df
Including auto_scheme.default_alg into binary (#1018)
chensuyue committed 340 days ago
Verified 6d03ec89
fix multi cuda ut bug (#1014)
n1ck-guo committed 341 days ago
Verified d00cc855
add ut for gguf alg_ext and update so file (#1012)
n1ck-guo committed 341 days ago
Verified 5c2f1bd7
fix bug (#1011)
wenhuach21 committed 342 days ago
Verified e3f96105
Minor refactor for LLMC (#993)
yiliu30 committed 342 days ago
Verified 6af724a5
add device list to clear memory (#1009)
wenhuach21 committed 342 days ago
Verified 1d02da16
Fix param missing bug (#1008)
mengniwang95 committed 342 days ago
Verified 7f9fa0ee
fix cuda CI (#1010)
Kaihui-intel committed 342 days ago
Verified b7ef006b
fix multiple devices issue in Compressor and AutoScheme (#1007)
wenhuach21 committed 344 days ago
Verified 344b40cf
Fix non auto device map (#1005)
WeiweiZhang1 committed 345 days ago
Verified cd54e705
fix multiple devices map issue in calibration (#1003)
wenhuach21 committed 345 days ago
Verified ead6f296
Fix diffusion multi-device ut issue (#1002)
mengniwang95 committed 345 days ago
Verified f6745fd9
Support for immediate saving to reduce ram usage (#965)
Kaihui-intel committed 345 days ago
Verified daeb3bb7
Refine exllamav2 ut (#1001)
WeiweiZhang1 committed 345 days ago
Verified 758b2390
refine md tables (#994)
WeiweiZhang1 committed 345 days ago
Verified c0aa30ab
fix mllm device_map ut (#1000)
Kaihui-intel committed 345 days ago
Verified 4aeca3ae
fix cuda ut bug (#999)
n1ck-guo committed 345 days ago
Verified d1bf7e8d
Reduce peak gpu memory usage and support moe estimation (#981)
xin3he committed 346 days ago
Verified 84e9a776
fix lm head bug and rm clear_mem_reach_threhold (#997)
wenhuach21 committed 346 days ago
Verified 284eecdd
[CI] Update python to 3.12 and torch to 2.8.0 (#741)
XuehaoSun committed 347 days ago
Verified 268f7dda
fix bug of cannot create adam compressor (#992)
n1ck-guo committed 347 days ago
Verified 05cab090
support model_dtype and fix bug of scheme contains quotes, mllm eval (#985)
n1ck-guo committed 348 days ago
Verified cd308ddb
add support for Magistral-Small (#980)
n1ck-guo committed 348 days ago
Verified dc6a6d3f
fix guff scheme and device_map bug (#969)
n1ck-guo committed 348 days ago
Verified be146c7f
update bits (#986)
xin3he committed 348 days ago
Verified 4afbe0ab
cli support for positional arguments model (#979)
n1ck-guo committed 349 days ago
Verified b9245b58
Terms Of Use Privacy Policy Refund Policy Impressum