intel/auto-round

Pull Requests Commits

FIXBUG: CPU Offloading for Cache Blocks in Low-Memory GPU Systems or Single GPU on ROCM Configs (#703)

JartX committed 148 days ago

Verified 61800412

fix xpu oom checker (#705)

n1ck-guo committed 148 days ago

Verified 32d2cd51

support for static activation quantization calibration with group_size (#693)

n1ck-guo committed 151 days ago

Verified 6afe07cb

support to save image_processor (#694)

n1ck-guo committed 151 days ago

Verified 4079a810

Add script for cuda unit test (#567)

XuehaoSun committed 151 days ago

Verified 4e617551

Update readme (#695)

wenhuach21 committed 152 days ago

Verified a598f17a

support static global scale for nvfp4 and update readme (#691)

wenhuach21 committed 152 days ago

Verified 4a3530fe

Add black and blacken-docs in pre-commit (#692)

XuehaoSun committed 155 days ago

Verified d424d3b4

support rceil for mxfp (#660)

wenhuach21 committed 156 days ago

Verified bec58a23

better log (#688)

wenhuach21 committed 156 days ago

Verified c6bde4b4

Add ruff and isort (#578)

XuehaoSun committed 156 days ago

Verified 774a5ae0

support to export static afp8 model (#662)

n1ck-guo committed 156 days ago

Verified 92bbaad3

fix ut import issue (#686)

WeiweiZhang1 committed 156 days ago

Verified 9e475278

bump version into v0.6.0 (#687)

XuehaoSun committed 157 days ago

Verified 5a07e4a7

fix gemma vlm gguf regression (#685)

wenhuach21 committed 157 days ago

Verified 3f36254c

fix gguf regression for large models (#680)

wenhuach21 committed 158 days ago

Verified 21bb06b6

update gguf convert file and fix bug of permute bug (#679)

n1ck-guo committed 158 days ago

Verified 4e1b81f9

rm_old_vlm_cuda_ut (#678)

WeiweiZhang1 committed 158 days ago

Verified 1ead9fe9

rm low_cpu when loading the model (#676)

wenhuach21 committed 159 days ago

Verified 2fe91d77

restrict accelerate version to reduce ram usage (#673)

wenhuach21 committed 159 days ago

Verified 308e5e36

fix 3bits asym accuracy and calib dataset issues (#674)

WeiweiZhang1 committed 159 days ago

Verified bc14beaf

add trust remote code to gguf format load tokenizer (#675)

n1ck-guo committed 159 days ago

Verified 9461bf91

support to use lm_eval for vlm (#670)

n1ck-guo committed 159 days ago

Verified 16b8a262

fix cuda hanging issue during packing (#669)

WeiweiZhang1 committed 162 days ago

Verified 7863f69d

fix ut issue (#668)

WeiweiZhang1 committed 162 days ago

Verified 0a8ebdfb

handle zeros in imatrix (#667)

wenhuach21 committed 163 days ago

Verified c1ea0d98

fix bugs of export deepseek gguf format when iters=0 and q3k accuracy (#665)

n1ck-guo committed 163 days ago

Verified 923683ae

fix gguf block-wise issue (#664)

wenhuach21 committed 163 days ago

Verified 313f436e

fix bug of block-wise quant imatrix (#663)

n1ck-guo committed 163 days ago

Verified 5d68aeb7

support vlm models for gguf format

n1ck-guo committed 164 days ago

Verified a2f3f016

Newer Older