intel/auto-round

Pull Requests Commits

Reduce peak gpu memory usage and support moe estimation (#981)

xin3he committed 73 days ago

Verified 84e9a776

fix lm head bug and rm clear_mem_reach_threhold (#997)

wenhuach21 committed 73 days ago

Verified 284eecdd

[CI] Update python to 3.12 and torch to 2.8.0 (#741)

XuehaoSun committed 74 days ago

Verified 268f7dda

fix bug of cannot create adam compressor (#992)

n1ck-guo committed 74 days ago

Verified 05cab090

support model_dtype and fix bug of scheme contains quotes, mllm eval (#985)

n1ck-guo committed 75 days ago

Verified cd308ddb

add support for Magistral-Small (#980)

n1ck-guo committed 75 days ago

Verified dc6a6d3f

fix guff scheme and device_map bug (#969)

n1ck-guo committed 75 days ago

Verified be146c7f

update bits (#986)

xin3he committed 75 days ago

Verified 4afbe0ab

cli support for positional arguments model (#979)

n1ck-guo committed 76 days ago

Verified b9245b58

refine readme (#978)

wenhuach21 committed 76 days ago

Verified 3f7bdace

enhance auto device map and support XPU (#961)

xin3he committed 79 days ago

Verified 06dd686a

disable compile packing by default (#975)

yiliu30 committed 79 days ago

Verified 8c767db6

fix cuda CI backend issue, fixtypo (#974)

WeiweiZhang1 committed 79 days ago

Verified 635eded9

merge main branch to alg_ext (#970)

wenhuach21 committed 79 days ago

Verified 9ecfaa5d

support for model scope (#957)

n1ck-guo committed 79 days ago

Verified 2448dcf2

clean code (#968)

wenhuach21 committed 79 days ago

Verified 3c1a6781

enhance flux doc (#967)

mengniwang95 committed 80 days ago

Verified 7635f7ea

fix rtn bug (#966)

mengniwang95 committed 80 days ago

Verified c4ef9a82

fix bug of imatrix contains 0 (#955)

n1ck-guo committed 80 days ago

Verified 5e33cbce

[1/N] Initial vllm-ext evaluation support (MXFP4 MOE) (#935)

yiliu30 committed 80 days ago

Verified e8bc3536

fix critic disable_opt_rtn regression (#963)

wenhuach21 committed 80 days ago

Verified 282aab66

update readme (#962)

wenhuach21 committed 80 days ago

Verified 7d8016d9

refine AutoScheme readme/code (#958)

wenhuach21 committed 81 days ago

Verified 8ac82a4a

add logo (#960)

wenhuach21 committed 81 days ago

Verified eb2facd9

add self attribution and fix avg_bits error (#956)

xin3he committed 81 days ago

Verified 12c49846

Reduce AutoSchem VRAM usage by up to 10X (#944)

wenhuach21 committed 81 days ago

Verified 90c2fb4c

update gguf and support for CompressedLinear (#950)

n1ck-guo committed 82 days ago

Verified fbb9c13b

update readme for sglang support (#953)

WeiweiZhang1 committed 82 days ago

Verified 824a21fb

refactor utils file (#943)

n1ck-guo committed 82 days ago

Verified f1b5c72b

update readme (#949)

wenhuach21 committed 83 days ago

Verified 959ac67c

Newer Older