intel/auto-round

Pull Requests Commits

[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot] committed 1 year ago

d46a1fe0

Merge branch 'main' into mengni/vlm

mengniwang95 committed 1 year ago

Verified a8803ec6

add ut and fix bug

mengniwang95 committed 1 year ago

2bab79dc

align formats packing device to API (#795)

WeiweiZhang1 committed 1 year ago

Verified dc81a878

rename llmcompressor to llm_compressor for align with other formats (#780)

WeiweiZhang1 committed 1 year ago

Verified e66652a4

fix bug and add nvfp in alg-ext with slight improvement (#794)

wenhuach21 committed 1 year ago

Verified 7e014ca3

Support auto device mapping (#781)

Kaihui-intel committed 1 year ago

Verified d7d2efad

torch backend bugfix and speedup ut (#793)

WeiweiZhang1 committed 1 year ago

Verified 4c597def

add limit arg for eval (#764)

n1ck-guo committed 1 year ago

Verified add749ac

refine nvfp4 algorithm (#790)

wenhuach21 committed 1 year ago

Verified 536810e1

Merge branch 'main' into mengni/vlm

mengniwang95 committed 1 year ago

Verified 1807d935

mxfp/nvfp/fp8 support torch compile in tuning (#789)

wenhuach21 committed 1 year ago

Verified 5f87a06b

refine nvfp code, typofix (#777)

WeiweiZhang1 committed 1 year ago

Verified fced2ba7

fix alg_ext regression and support mxfp4 in it with slight improvement (#785)

wenhuach21 committed 1 year ago

Verified ca3f733e

hot fix for nfp4 scheme (#784)

wenhuach21 committed 1 year ago

Verified 7e52af2a

Speedup FP4 packing (#766)

yiliu30 committed 1 year ago

Verified 253b48f2

[API CHANGE] Stage 1 add quant scheme and consolidate device and device_map (#774)

wenhuach21 committed 1 year ago

Verified 8bcf7eab

Merge branch 'main' into mengni/vlm

mengniwang95 committed 1 year ago

Verified 2ecd5c43

[pre-commit.ci] auto fixes from pre-commit.com hooks

pre-commit-ci[bot] committed 1 year ago

db709c3a

mengniwang95 committed 1 year ago

42ffe97c

mengniwang95 committed 1 year ago

d17bfe70

remove hard code

mengniwang95 committed 1 year ago

27b7b7ca

mengniwang95 committed 1 year ago

8138835b

mengniwang95 committed 1 year ago

9db0c865

fix get_block_names

mengniwang95 committed 1 year ago

1c988ae1

fix pbar and generator seed

mengniwang95 committed 1 year ago

8dbbd98b

mengniwang95 committed 1 year ago

b89e1458

gguf format supports for fp8 model (#778)

n1ck-guo committed 1 year ago

Verified 572aad1d

fix bug of auto_round exporting (#772)

n1ck-guo committed 1 year ago

Verified d01704da

support eval after quantization

mengniwang95 committed 1 year ago

d920a95e

Older