intel/auto-round

Pull Requests Commits

yiliu30 committed 266 days ago

4a01ca8c

Fix llm-compressor export (#820)

Kaihui-intel committed 270 days ago

Verified 40aed064

Refine logger and add envs (#817)

yiliu30 committed 270 days ago

Verified c5302e16

fix nsamples in get_dataloader (#804)

wenhuach21 committed 271 days ago

Verified 00fff814

Bump release version to v0.7.0 (#814)

XuehaoSun committed 272 days ago

Verified 30d1061f

fix gptqmodel inference issue (#813)

wenhuach21 committed 272 days ago

Verified c4e7fbe5

fix bug of q_layer_inputs (#811)

n1ck-guo committed 272 days ago

Verified e1ae6e93

Support loading for static quant weight fp8 act fp8 (#730)

yiliu30 committed 272 days ago

Verified 09e4d312

remove torch compile (#807)

wenhuach21 committed 272 days ago

Verified 1452d95f

fix cuda ut bug of use_deterministic_algorithms (#805)

n1ck-guo committed 272 days ago

Verified 886d6571

fix mxfp exporting (#806)

WeiweiZhang1 committed 272 days ago

Verified 520c78fe

improve the robustness of scheme (#803)

wenhuach21 committed 273 days ago

Verified 9534d2ac

AutoRoundMLLM supports scheme and fix device_map=dict regression (#801)

n1ck-guo committed 273 days ago

Verified 78fce450

enable model python files saving (#802)

WeiweiZhang1 committed 273 days ago

Verified da089e9f

fix several cuda ut bug (#797)

n1ck-guo committed 274 days ago

Verified ab55a973

fix typo in readme (#799)

wenhuach21 committed 274 days ago

Verified e39f25e1

refine readme (#798)

wenhuach21 committed 274 days ago

Verified bc045f93

fix several regressions including lm-head quantization, 3bit asym torch backend,etc (#796)

wenhuach21 committed 274 days ago

Verified 08d6b9e7

add fp8 export format check (#779)

n1ck-guo committed 274 days ago

Verified 5ead4c6d

align formats packing device to API (#795)

WeiweiZhang1 committed 276 days ago

Verified dc81a878

rename llmcompressor to llm_compressor for align with other formats (#780)

WeiweiZhang1 committed 276 days ago

Verified e66652a4

fix bug and add nvfp in alg-ext with slight improvement (#794)

wenhuach21 committed 277 days ago

Verified 7e014ca3

Support auto device mapping (#781)

Kaihui-intel committed 277 days ago

Verified d7d2efad

torch backend bugfix and speedup ut (#793)

WeiweiZhang1 committed 277 days ago

Verified 4c597def

add limit arg for eval (#764)

n1ck-guo committed 277 days ago

Verified add749ac

refine nvfp4 algorithm (#790)

wenhuach21 committed 277 days ago

Verified 536810e1

mxfp/nvfp/fp8 support torch compile in tuning (#789)

wenhuach21 committed 278 days ago

Verified 5f87a06b

refine nvfp code, typofix (#777)

WeiweiZhang1 committed 278 days ago

Verified fced2ba7

fix alg_ext regression and support mxfp4 in it with slight improvement (#785)

wenhuach21 committed 278 days ago

Verified ca3f733e

hot fix for nfp4 scheme (#784)

wenhuach21 committed 279 days ago

Verified 7e52af2a

Older