intel/auto-round

Pull Requests Commits
add initial support of mxfp4 (#187)
wenhuach21 committed 2 years ago
Verified d48d0404
[pre-commit.ci] pre-commit autoupdate (#167)
pre-commit-ci[bot] committed 2 years ago
Verified 9226a893
fix typos (#185)
wenhuach21 committed 2 years ago
Verified 24b2e740
Add layer wise mode to save memory (#136)
n1ck-guo committed 2 years ago
Verified e2e33f03
enable llava & Qwen-VL multimodal model quantization (#165)
WeiweiZhang1 committed 2 years ago
Verified aeb9e408
Fix UT coverage report (#180)
XuehaoSun committed 2 years ago
Verified 8d08400f
fix autoround format mixed precision issue and refine gptq format code (#183)
wenhuach21 committed 2 years ago
Verified e2814996
Fix autoround format accuracy issue (#179)
wenhuach21 committed 2 years ago
Verified 0126180f
Add unit test (#173)
XuehaoSun committed 2 years ago
Verified 81624095
add initial support for activation quantization (#176)
wenhuach21 committed 2 years ago
Verified 5f67048c
speedup the tuning a little (#175)
wenhuach21 committed 2 years ago
Verified 473f474d
add chat template in calib tokenization (#171)
yintong-lu committed 2 years ago
Verified 735dfc9e
[Large impact]set the default nsamples to 128 and low_gpu_mem_usage to False (#174)
wenhuach21 committed 2 years ago
Verified ab614824
support marlin in auto_round format (#172)
wenhuach21 committed 2 years ago
Verified 2b1448d4
revert the gptq format code to fix the regression (#168)
wenhuach21 committed 2 years ago
Verified 5947e9c0
fix typos, update overview img (#166)
WeiweiZhang1 committed 2 years ago
Verified 8d5765ac
1 fix a bug in autoround format with the latest transformers 2 rename n_samples n_blocks to nsamples nblocks (#163)
wenhuach21 committed 2 years ago
Verified f9e7d79e
bugfix (#160)
WeiweiZhang1 committed 2 years ago
Verified 31c566cc
fix bug and limit numpy version (#159)
yintong-lu committed 2 years ago
Verified 77320b0a
support calibration dataset concat (#147)
yintong-lu committed 2 years ago
Verified 75e3fde0
remove gpt ppl eval from lm-0.4.2 (#158)
wenhuach21 committed 2 years ago
Verified 77d6a886
fix bug at whole block is excluded from quantization (#156)
wenhuach21 committed 2 years ago
Verified edcec56e
auto round quantizer supports gptq kernel (#155)
wenhuach21 committed 2 years ago
Verified 9cae103d
fix qbits issue (#153)
wenhuach21 committed 2 years ago
Verified c313fa33
Qbits related log (#151)
zhewang1-intc committed 2 years ago
Verified 34274fb3
autoround_support_qbits_backend (#145)
zhewang1-intc committed 2 years ago
Verified dbdc4a39
fix incorrect setting for lm-head (#149)
wenhuach21 committed 2 years ago
Verified 9da2beed
fix triton issue (#148)
wenhuach21 committed 2 years ago
Verified 04ea8694
refine the code (#143)
wenhuach21 committed 2 years ago
Verified 59c64022
Fix exlllamav2 backend issue (#144)
wenhuach21 committed 2 years ago
Verified e614d138
Terms Of Use Privacy Policy Refund Policy Impressum