intel/auto-round

Pull Requests Commits

[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot] committed 206 days ago

d46a1fe0

Merge branch 'main' into mengni/vlm

mengniwang95 committed 206 days ago

Verified a8803ec6

add ut and fix bug

mengniwang95 committed 206 days ago

2bab79dc

align formats packing device to API (#795)

WeiweiZhang1 committed 209 days ago

Verified dc81a878

rename llmcompressor to llm_compressor for align with other formats (#780)

WeiweiZhang1 committed 209 days ago

Verified e66652a4

fix bug and add nvfp in alg-ext with slight improvement (#794)

wenhuach21 committed 209 days ago

Verified 7e014ca3

Support auto device mapping (#781)

Kaihui-intel committed 209 days ago

Verified d7d2efad

torch backend bugfix and speedup ut (#793)

WeiweiZhang1 committed 209 days ago

Verified 4c597def

add limit arg for eval (#764)

n1ck-guo committed 209 days ago

Verified add749ac

refine nvfp4 algorithm (#790)

wenhuach21 committed 209 days ago

Verified 536810e1

Merge branch 'main' into mengni/vlm

mengniwang95 committed 210 days ago

Verified 1807d935

mxfp/nvfp/fp8 support torch compile in tuning (#789)

wenhuach21 committed 210 days ago

Verified 5f87a06b

refine nvfp code, typofix (#777)

WeiweiZhang1 committed 210 days ago

Verified fced2ba7

fix alg_ext regression and support mxfp4 in it with slight improvement (#785)

wenhuach21 committed 211 days ago

Verified ca3f733e

hot fix for nfp4 scheme (#784)

wenhuach21 committed 211 days ago

Verified 7e52af2a

Speedup FP4 packing (#766)

yiliu30 committed 211 days ago

Verified 253b48f2

[API CHANGE] Stage 1 add quant scheme and consolidate device and device_map (#774)

wenhuach21 committed 211 days ago

Verified 8bcf7eab

Merge branch 'main' into mengni/vlm

mengniwang95 committed 212 days ago

Verified 2ecd5c43

[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot] committed 212 days ago

db709c3a

mengniwang95 committed 212 days ago

42ffe97c

mengniwang95 committed 212 days ago

d17bfe70

remove hard code

mengniwang95 committed 212 days ago

27b7b7ca

mengniwang95 committed 212 days ago

8138835b

mengniwang95 committed 212 days ago

9db0c865

fix get_block_names

mengniwang95 committed 212 days ago

1c988ae1

fix pbar and generator seed

mengniwang95 committed 212 days ago

8dbbd98b

mengniwang95 committed 212 days ago

b89e1458

gguf format supports for fp8 model (#778)

n1ck-guo committed 212 days ago

Verified 572aad1d

fix bug of auto_round exporting (#772)

n1ck-guo committed 212 days ago

Verified d01704da

support eval after quantization

mengniwang95 committed 213 days ago

d920a95e

Older