intel/auto-round

Pull Requests Commits
Add LLMC integration test (#1053)
yiliu30 committed 197 days ago
Verified 9c02a926
export kv scheme (#1068)
yiliu30 committed 197 days ago
Verified e96756c1
Optimize CPU CI pipelines (#1071)
XuehaoSun committed 198 days ago
Verified 2ef7f318
Add compatibility test for ARM (#1073)
XuehaoSun committed 198 days ago
Verified be56548a
support for gguf mixed q2_k_s (#1059)
n1ck-guo committed 198 days ago
Verified e5755588
remove tbb (#1069)
yiliu30 committed 199 days ago
Verified e1ec8552
Add static FP8 attention support (#1061)
yiliu30 committed 199 days ago
Verified 6bde0e11
fix transformers==4.57.1 in CI (#1066)
XuehaoSun committed 199 days ago
Verified ede64fa4
refine readme (#1063)
wenhuach21 committed 199 days ago
Verified 2102257e
Revert "Add static FP8 attention support (#1045)" (#1060)
yiliu30 committed 200 days ago
Verified 6d40e20a
Enhance tokenizer saving (#1057)
mengniwang95 committed 200 days ago
Verified 4ec50d1c
Add static FP8 attention support (#1045)
yiliu30 committed 200 days ago
Verified c5b1c412
[High Risk]reduce vram usage for optimized RTN mode (#1043)
wenhuach21 committed 200 days ago
Verified e1b89d23
Announce llmc integration (#1055)
yiliu30 committed 203 days ago
Verified 90871a71
set add_bos_token=True for llama model (#1046)
n1ck-guo committed 204 days ago
Verified 924a4682
Update get_block_names func (#1047)
mengniwang95 committed 204 days ago
Verified 548acbb0
add memory monitor and import auto-scheme on demand (#1049)
wenhuach21 committed 204 days ago
Verified 247a9a7b
add environment.md and remove AutoRoundMLLM usage in readme (#1042)
xin3he committed 205 days ago
Verified c640c725
fix accuracy regression (#1041)
wenhuach21 committed 207 days ago
Verified 6a8ac7e0
Bump into v0.9.0 (#1024)
XuehaoSun committed 210 days ago
Verified 8d8a1cd5
fix incorrect model name (#1035)
wenhuach21 committed 210 days ago
Verified 509ac2c3
optimize vram for gguf and add momentum (#1031)
wenhuach21 committed 210 days ago
Verified 58b3d90a
update gguf alg ext (#1026)
n1ck-guo committed 210 days ago
Verified 81caded3
Reduce mem usage of GPT-OSS (#1013)
yiliu30 committed 210 days ago
Verified 6d3d87d0
Fix the missing temporary name (#1029)
yiliu30 committed 210 days ago
Verified c4d030da
fix bug of lm_head and dispatch model,gguf eval (#1025)
n1ck-guo committed 211 days ago
Verified 2fb3ee1b
disable itrex format first (#998)
WeiweiZhang1 committed 212 days ago
Verified 395602b7
fix cuda ut (#1020)
n1ck-guo committed 212 days ago
Verified 797f476a
dispatch model with real max memory (#1022)
xin3he committed 212 days ago
Verified 255322fb
add num_device check for set_auto_device_map_for_block_with_tuning (#1021)
xin3he committed 212 days ago
Verified a3d422df
Terms Of Use Privacy Policy Refund Policy Impressum